The Conservative MP says 'now it's time to focus on Beverley and Holderness'