The stunning piece of Welsh history has been vacant since the early 1980s