The Queen is said to have been closer to one royal female above any other, with the exception of her daughter Princess Anne