The NDIS minister will leave parliament weeks earlier than expected, raising expectations the Prime Minister will move for a quick cabinet reshuffle.