Agree absolutely about the private speculation, but at that point, if you have to say something, why not just say "I'd appreciate it if you all would restrict your remarks to my work, and leave my private life out of these reviews. They're entirely different things."

It is sad, isn't it?