The leader of Reform UK said his concerns about the impact of migration on UK towns and cities had nothing to do with the declining white British population.