Plans to convert the site into housing were approved last year