A man has been left feeling guilty after refusing to give up his seat on a packed train to a mum who was 'clearly frazzled', because he was 'exhausted' after a tough day