A restaurant owner is disappointed that he cannot keep the glazed extension to the front of his premises after a planning appeal was dismissed.