The singer announced earlier this week he would not be playing at this year's music festival