More than 100 people have objected to plans to convert a cemetery lodge into a place of worship.