Devolved administrations felt they were “politely entertained but not really listened to” by Whitehall during the Covid-19 pandemic, Stormont’s former finance minister has said.