Colchester United boss Danny Cowley said that his team should never have lost against Swindon Town following their 3-2 New Year’s Day defeat.