The Prime Minister will stay in post until a new leader is chosen