The man and his wife had been enjoying Melbourne Cup celebrations when he was allegedly set upon.