The singer revealed her love of the Potteries during an interview at Glastonbury