A major North Yorkshire heritage site has received considerable damage after being targeted by vandals.