While it's not known yet how she'll leave, the character will soon be saying goodbye to Weatherfield