A popular museum in Henley, Oxfordshire is set to close due to “financial pressures”.