Planners have refused plans to convert it into a car and van hire office