Something as small as a phrase you say or an outfit you wear can feel like it holds sway over your future