Kelsey Grammer revealed the couple had bought a 'little place' in Portishead to be closer to his wife's family