A previous plan for the first floor of the Stafford building was also refused permission