Residents fear the more than 400 daily vehicle movements will worsen traffic woes