The Aussie international's three year stay in Gorgie is about to come to an end