No plans have been brought forward but retirement homes could be built on the site