JOE RAFFERTY had hoped to be swapping one promotion fight for another when he joined Rotherham United from Portsmouth last summer.