Conservative Leader Pierre Poilievre says a government led by him would cut the number of federal public servants — but he doesn't mind if they work from home.