Identification and Cross-Country Comparison of Students' Test-Taking Behaviors in Selected eTIMSS 2019 Countries

Autor/inn/en	Zheng, Xiaying; Sahin, Fusun; Erberber, Ebru; Fonseca, Frank
Titel	Identification and Cross-Country Comparison of Students' Test-Taking Behaviors in Selected eTIMSS 2019 Countries
Quelle	In: Large-scale Assessments in Education, 11 (2023), Artikel 32 (14 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Zheng, Xiaying)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
DOI	10.1186/s40536-023-00179-3
Schlagwörter	Identification; Test Wiseness; Achievement Tests; Foreign Countries; International Assessment; Student Behavior; Grade 8; Secondary School Students; Profiles; Mathematics Tests; Mathematics Achievement; United Kingdom (England); Singapore; United Arab Emirates; United States; Trends in International Mathematics and Science Study + Suchen Sie Ihr Suchwort? Identifikation; Identifizierung; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Ausland; Student behaviour; Schülerverhalten; School year 08; 8. Schuljahr; Schuljahr 08; Sekundarschüler; Charakterisierung; Profilanalyse; Mathmatics sikills; Mathmatics achievement; Mathematical ability; Mathematische Kompetenz; Singapur; Vereinigte Arabische Emirate; USA
Abstract	Unfavorable test-taking behaviors, such as speededness and disengagement, have long been a validity concern for large-scale low-stakes assessments. Understanding the presence and extent of such behaviors is important for ensuring the validity of inferences based on test scores. This study examined test-taking behaviors using item response time (RT), a process data-derived variable from the TIMSS 2019 database. Analyses compared the United States to three other countries (England, Singapore, and the United Arab Emirates) that administered the digital version of TIMSS (eTIMSS) 2019 in English at grade 8. Test-taking behaviors were identified within each country and compared within and across countries. Specifically, to identify distinct types of test-taking behaviors, mixture modeling was employed on RT and item scores from Booklet 1, Part 1, of the eTIMSS 2019 eighth-grade assessment. The results indicated that each country had several latent classes of students with different pacing trajectories and performance. The test-taking behaviors of these latent classes were labeled as "Steady;" "Disengaged" or "Very disengaged;" "Speeded" or "Very speeded;" and "Efficient" and "high-performing." Most of the students in each country had a "Steady" pace (medium to high sum score; steady RT throughout the test): 71% in England, 74% in both Singapore and the United Arab Emirates, and 84% in the United States. "Disengaged" or "Very disengaged" students (low sum score; short RT) were identified in each country but were more prevalent in England and the United Arab Emirates (above 20% in both) than in the United States and Singapore (both below 10%). The study also revealed small percentages of "Speeded" or "Very speeded" students (low to medium sum score; long RT at first but very short RT toward the end) in England, the United Arab Emirates, and the United States (1%, 5%, and 6%, respectively) but not in Singapore. A unique class of "Efficient and high-performing" students (high sum score; short RT) was identified only in Singapore (24%). This study demonstrated that mixture modeling is a useful technique for identifying distinct test-taking behaviors and highlighted the presence and extent of unfavorable test-taking behaviors within each selected country using data from Booklet 1, Part 1, of the eTIMSS 2019 eighth-grade assessment. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01