Durham County Council has warned that building new leisure centres and improving existing facilities would be too risky and cost £109 million.