‘That’s obviously social climbing going on there, right?’ he said, adding, ‘I don’t mean it like that’