Federal Labor is taking “nothing for granted” after their Victorian state level colleagues took a hit in by-elections over the weekend.