The pub landlord has complained that Labour has ‘put the fear of God into people’