PLANS to turn a vacant town centre office building into a tearoom and hotel have been refused.