Punters have expressed their sadness after a town centre pub's landlords announced they would be leaving.