As Canadians take time off to celebrate the holidays, many federal offices, stores and businesses will be closed across the country on New Year's Day.