From tees and shorts to chinos and joggers—here's how the two measure up against each other.