Security Minister Dan Jarvis said an MP’s ‘primary focus’ should be on local issues