The Conservatives have accused Sir Keir Starmer of being a "weak Prime Minister."