A senior councillor was removed from his administration role “over disagreements about comments he made”.