Green Party supporters came in second to Conservative voters