Prime Minister Sir Keir Starmer has ruled out calling another general election, but said he is “not surprised” some people who did not support Labour might want a second poll.