Neighbours are fighting plans to turn a garden building in the fishing village into a short-term let amid tourism boom in Aberdeen.