Automatic summary assessment for intelligent tutoring systems

Yulan He, Siu C. Hui, Tho T. Quan

Research output: Contribution to journalArticlepeer-review

Abstract

Summary writing is an important part of many English Language Examinations. As grading students' summary writings is a very time-consuming task, computer-assisted assessment will help teachers carry out the grading more effectively. Several techniques such as latent semantic analysis (LSA), n-gram co-occurrence and BLEU have been proposed to support automatic evaluation of summaries. However, their performance is not satisfactory for assessing summary writings. To improve the performance, this paper proposes an ensemble approach that integrates LSA and n-gram co-occurrence. As a result, the proposed ensemble approach is able to achieve high accuracy and improve the performance quite substantially compared with current techniques. A summary assessment system based on the proposed approach has also been developed.
Original languageEnglish
Pages (from-to)890-899
Number of pages10
JournalComputers and Education
Volume53
Issue number3
DOIs
Publication statusPublished - Nov 2009

Bibliographical note

NOTICE: this is the author’s version of a work that was accepted for publication in Computers and education. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in He, Y, Hui, SC & Quan, TT, 'Automatic summary assessment for intelligent tutoring systems' Computers and education, vol. 53, no. 3 (2009) DOI http://dx.doi.org/10.1016/j.compedu.2009.05.008.

Keywords

  • summary writing assessment
  • intelligent tutoring systems
  • latent semantic analysis
  • N-gram co-occurrence
  • adaptive feedback

Fingerprint

Dive into the research topics of 'Automatic summary assessment for intelligent tutoring systems'. Together they form a unique fingerprint.

Cite this