Ben Affleck is leaving the rental property he moved to during his marital struggles with Jennifer Lopez and heading to a new $20M pad.