Hard-working MP's reputation is already in tatters, by saying nothing he is making things worse, writes Liam Thorp