Humphries fired back at the two-time world champion - and said his barbs wouldn't affect Luke Littler either