Concerns were raised at a council meeting about a building described as resembling an 'oversized Amazon box'