Djokovic has spent more than 400 weeks at number one and now sits fifth in the rankings