Councillors at Huntingdonshire District Council said no one wanted to see homes sitting empty during a housing crisis