Newly released official files lift lid on how ministers expressed concerns over unrestricted access for workers from new EU countries