Fans thought the cable knit piece was 'smart enough to be dressed up' but could also be worn casually