Many still associate the town with gorgeous beaches and a lovely day out, but some have a very different view.