Housing Minister Sean Fraser will announce on Monday that he will not seek re-election in his Nova Scotia riding and will leave the federal cabinet during the next shuffle, CBC News has learned.