A ‘backyard barbershop’ has lost its battle with the council to remain open after being built illegally.