Primary schools in England where pupil numbers have fallen sharply are not reducing class sizes, a report has suggested.