A New Brunswick Conservative MP running for re-election this year is losing some of his supporters after a falling out with former staffers and resignations from the local party organization.