More than 40 people have objected to plans for a former pub to be converted into a family home.