One Labour minister said it was 'about time we stood up to Musk' over his comments about the UK