PLANS to change the use of the upper floors of a Weymouth Esplanade building to five flats have been refused.