The council defended its decision after handing out a huge £3,200 bill for the property that's been empty for two years