AAP supremo Arvind Kejriwal was also part of the meeting of the party's 22 MLAs