There are growing fears for the future of Abbey Stadium as survey work is carried out on-site.