A village pub can be pulled down to make way for bungalows after councillors heard that it was taking less than £70 on some days.