Controversial actor Armie Hammer, who had been out of the spotlight due to allegations against him, discussed his strained relationship with his mother