Residents shared their fears it would 'change the character of the neighbourhood'