He claims the potential political shake-up also 'makes no sense geographically'