Commissioner Selwyn Patterson is set to leave Saint Marie for good after the Death In Paradise character was given his marching orders by the Caribbean team