Swansea boss Luke Williams thought his side were second best for the majority of the contest despite earning a 2-1 win at Derby.