Literaturnachweis - Detailanzeige
Autor/inn/en | Song, Yi; Deane, Paul; Beigman Klebanov, Beata |
---|---|
Titel | Toward the Automated Scoring of Written Arguments: Developing an Innovative Approach for Annotation. Research Report. ETS RR-17-11 |
Quelle | In: ETS Research Report Series, (2017), (17 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 2330-8516 |
Schlagwörter | Scoring; Automation; Persuasive Discourse; Documentation; Essays; Writing Tests; Classification; Reliability; Identification; College Students |
Abstract | This project focuses on laying the foundations for automated analysis of argumentation schemes, supporting identification and classification of the arguments being made in a text, for the purpose of scoring the quality of written analyses of arguments. We developed annotation protocols for 20 argument prompts from a college-level test under the framework of the theory of argumentation schemes, which defines reasoning patterns in argumentation. The annotation protocols listed critical questions associated with each argumentation scheme, which makes the argument structure in a text explicit and classifiable. Furthermore, we annotated 200 student essays across four selected argument prompts to test if the annotation protocols can be applied reliably by human annotators. Preliminary results indicate that this method of analyzing argument structure is reliable and promising. (As Provided). |
Anmerkungen | Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2020/1/01 |