The Future of Standardised Assessment: Validity and Trust in Algorithms for Assessment and Scoring

Autor/in	Aloisi, Cesare
Titel	The Future of Standardised Assessment: Validity and Trust in Algorithms for Assessment and Scoring
Quelle	In: European Journal of Education, 58 (2023) 1, S.98-110 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0141-8211
DOI	10.1111/ejed.12542
Schlagwörter	Standardized Tests; Test Validity; Credibility; Algorithms; Scoring; Artificial Intelligence; High Stakes Tests; Secondary School Students + Suchen Sie Ihr Suchwort? Standadised tests; Standardisierter Test; Testvalidität; Glaubwürdigkeit; Algorithm; Algorithmus; Bewertung; Künstliche Intelligenz; Sekundarschüler
Abstract	This article considers the challenges of using artificial intelligence (AI) and machine learning (ML) to assist high-stakes standardised assessment. It focuses on the detrimental effect that even state-of-the-art AI and ML systems could have on the validity of national exams of secondary education, and how lower validity would negatively affect trust in the system. To reach this conclusion, three unresolved issues in AI (unreliability, low explainability and bias) are addressed, to show how each of them would compromise the interpretations and uses of exam results (i.e., exam validity). Furthermore, the article relates validity to trust, and specifically to the ABI+ model of trust. Evidence gathered as part of exam validation supports each of the four trust-enabling components of the ABI+ model (ability, benevolence, integrity and predictability). It is argued, therefore, that the three AI barriers to exam validity limit the extent to which an AI-assisted exam system could be trusted. The article suggests that addressing the issues of AI unreliability, low explainability and bias should be sufficient to put AI-assisted exams on par with traditional ones, but might not go as far as fully reassure the public. To achieve this, it is argued that changes to the quality assurance mechanisms of the exam system will be required. This may involve, for example, integrating principled AI frameworks in assessment policy and regulation. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01