EXCLUSIVE: Residents of the upmarket seaside town couldn't believe it had been named one of the worst places to live.