A former Darlington council leader has defended his decision not to attend scrutiny meetings since re-election in 2023.