An exit poll has put Ireland's Sinn Fein in the lead at the general election, but its rivals appear likely to have enough votes to form a coalition government.