Veterans Affairs Minister Ginette Petitpas Taylor will temporarily take on his cabinet portfolios