Martin Clunes' ITV drama Out There has been dealt a major blow.