The former factory has been left empty since the late 1970s and is now in a 'poor state of repair'