Mim Goldsmith said she was told to 'go live in a nursing home'