‘I think fame is something you should consent to,’ singer said