Fully rebuilding a much-loved special school for deaf pupils may yet be three years away.