Polling for by-elections at two assembly constituencies - Budhni in Sehore district and Vijaypur seat in Sheopur district, in Madhya Pradesh began on Wednesday morning.