Anthony Albanese is pushing back against accusations he has not been tough enough on a rising tide of anti-Semitism in Australia.