Prime Minister Anthony Albanese addressed concerns over Victoria pulling out of hosting the lower-tier men's world championship event