In 2022, the ‘Pretty Woman’ actor purchased the 32-acre property for $10.8m