A popular Southsea gift shop is having to close for a number of weeks to allow essential building work to take place on the front of the building.