The Fighter actor moved his family from California to Las Vegas in 2022. He spoke about the major shift in March 2024