The Graham actor admitted 'bursting the bubble' when he spilled behind-the-scenes secrets from the 2006 Christmas classic