The Crown Estate, which looks after them, says profits raised already go into the public purse