A Comparison of Human and Computer Marking of Short Free-Text Student Responses

Autor/inn/en	Butcher, Philip G.; Jordan, Sally E.
Titel	A Comparison of Human and Computer Marking of Short Free-Text Student Responses
Quelle	In: Computers & Education, 55 (2010) 2, S.489-499 (11 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0360-1315
DOI	10.1016/j.compedu.2010.02.012
Schlagwörter	Computational Linguistics; Comparative Analysis; Information Retrieval; Feedback (Response); Reader Text Relationship; Computer Mediated Communication; Information Technology; Computers + Suchen Sie Ihr Suchwort? Linguistics; Computerlinguistik; Computerkonferenz; Informationstechnologie; Digitalrechner
Abstract	The computer marking of short-answer free-text responses of around a sentence in length has been found to be at least as good as that of six human markers. The marking accuracy of three separate computerised systems has been compared, one system (Intelligent Assessment Technologies FreeText Author) is based on computational linguistics whilst two (Regular Expressions and OpenMark) are based on the algorithmic manipulation of keywords. In all three cases, the development of high-quality response matching has been achieved by the use of real student responses to developmental versions of the questions and FreeText Author and OpenMark have been found to produce marking of broadly similar accuracy. Reasons for lack of accuracy in human marking and in each of the computer systems are discussed. (Contains 6 tables and 1 figure.) (As Provided).
Anmerkungen	Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10