Fraser star Kelsey Grammer has been given the greenlight to demolish a historic 200-year-old cottage - despite several complaints from neighbours.