Uttar Pradesh Congress President Ajay Rai on Tuesday announced that his party will extend full support to the Samajwadi Party (SP) for the upcoming Milkipur Assembly by-elections, scheduled to be held on February 5.