Immigration levels is a topic he has long avoided touching