When the restaurant was a mill house, it was visited by Queen Elizabeth I