The defender has had to wait a long time to kick-start his Spurs career