Hundreds of residents in a pretty market town are up in arms over plans to open a Greggs' store on their high street.