Contractors have begun to demolish the most historic part of a landmark building with links to the creator of Sherlock Holmes