A town library in Oxfordshire is to get a major upgrade with an enhanced children’s area and dedicated study and work spaces.