Four men who claimed they were sexually abused as students by a teacher in the late 1970s were not jointly lying to gain over $2.5 million, a judge has heard.