A decline in visitors to York’s museums and gallery will continue without significant investment to improve buildings and their facilities, a report has warned.