‘Don’t let planning rules ruin a great restaurant’ - that was the overwhelming call of residents after planners threatened to force them to remove part of their building.