An elderly man in Lancashire had a “significant amount of money” stolen after he gave his bank cards to scammers.