There is frustration over the impact of Welsh Government ministerial changes