Could an Artificial-Intelligence Agent Pass an Introductory Physics Course?

Autor/in	Kortemeyer, Gerd
Titel	Could an Artificial-Intelligence Agent Pass an Introductory Physics Course?
Quelle	In: Physical Review Physics Education Research, 19 (2023) 1, Artikel 010132 (18 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Kortemeyer, Gerd)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Artificial Intelligence; Physics; Science Instruction; Introductory Courses; Case Studies; Calculus; Misconceptions; Futures (of Society); Computational Linguistics; Computer Software; Natural Language Processing; Phrase Structure; Science Tests; Scientific Concepts; State Universities; Error Patterns; Teaching Methods; Michigan; Force Concept Inventory + Suchen Sie Ihr Suchwort? Künstliche Intelligenz; Physik; Teaching of science; Science education; Natural sciences Lessons; Naturwissenschaftlicher Unterricht; Einführungskurs; Case study; Fallstudie; Case Study; Analysis; Differenzialrechnung; Infinitesimalrechnung; Integralrechnung; Missverständnis; Future; Society; Zukunft; Linguistics; Computerlinguistik; Natürliche Sprache; Phrasenstruktur; Staatliche Universität; Fehlertyp; Teaching method; Lehrmethode; Unterrichtsmethode
Abstract	Massive pretrained language models have garnered attention and controversy due to their ability to generate humanlike responses: Attention due to their frequent indistinguishability from human-generated phraseology and narratives and controversy due to the fact that their convincingly presented arguments and facts are frequently simply false. Just how humanlike are these responses when it comes to dialogues about physics, in particular about the standard content of introductory physics courses? This case study explores that question by having ChatGPT, the preeminent language model in 2023, work through representative assessment content of an actual calculus-based physics course and grading the responses in the same way human responses would be graded. As it turns out, ChatGPT would narrowly pass this course while exhibiting many of the preconceptions and errors of a beginning learner. A discussion of possible consequences for teaching, testing, and physics education research is provided as a possible starter for more detailed studies and curricular efforts in the future. (As Provided).
Anmerkungen	American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: https://journals.aps.org/prper/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01