The leader of Inverclyde Council's Conservative group has handed over the reins of party power after more than 17 years.