I'm sure that anecdote provokes — in some circles — the countersnark: If he doesn't like it, he ought to retire. And, in fact, the linked article describes a recent Brooklyn Law School appearance at which a student asked:
"There have been many calls for Justice Ginsburg to retire... Would you take some of the pressure off her and retire instead?"We're told there was "a roar of laughter." Scalia said: "Sure, I'll retire. As soon as there's a decently conservative President in office to appoint my successor." I'm just kidding. He said: "I said I would take questions—I didn't say I would answer them."
Which is almost as cheeky as the time Chief Justice Rehnquist, asked if he'd retire, said: "That's for me to know and you to find out."