Chief Minister Siddaramaiah issued a stern warning against the use of rowdy elements and goons for loan recovery.