A man was branded 'heartless' after he refused to swap seats with another passenger on a flight - but was most horrified by the passenger's other six-word response