Rule-Based Process Indicators of Information Processing Explain Performance Differences in PIAAC Web Search Tasks

Autor/inn/en	Hahnel, Carolin; Kroehne, Ulf; Goldhammer, Frank
Titel	Rule-Based Process Indicators of Information Processing Explain Performance Differences in PIAAC Web Search Tasks
Quelle	In: Large-scale Assessments in Education, 11 (2023), Artikel 16 (25 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Hahnel, Carolin) ORCID (Kroehne, Ulf) ORCID (Goldhammer, Frank)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
DOI	10.1186/s40536-023-00169-5
Schlagwörter	Adults; Search Strategies; Users (Information); Information Seeking; Online Searching; Web Sites; Information Processing; Behavior Patterns; Age Differences; Standards; Lifelong Learning; Performance; Individual Characteristics; Use Studies; Program for the International Assessment of Adult Competencies (PIAAC) + Suchen Sie Ihr Suchwort? Suchstrategie; Benutzerprofil; Nutzer; Informationserschließung; Online-Recherche; Web-Design; Informationsverarbeitung; Age; Difference; Age difference; Altersunterschied; Standard; Life-long learning; Lebenslanges Lernen; Achievement; Leistung; Personality characteristic; Personality traits; Persönlichkeitsmerkmal; Benutzerschulung
Abstract	Background: A priori assumptions about specific behavior in test items can be used to process log data in a rule-based fashion to identify the behavior of interest. In this study, we demonstrate such a top-down approach and created a process indicator to represent what type of information processing (flimsy, breadth-first, satisficing, sampling, laborious) adults exhibit when searching online for information. We examined how often the predefined patterns occurred for a particular task, how consistently they occurred within individuals, and whether they explained task success beyond individual background variables (age, educational attainment, gender) and information processing skills (reading and evaluation skills). Methods: We analyzed the result and log file data of ten countries that participated in the "Programme for the International Assessment of Adult Competencies" (PIAAC). The information processing behaviors were derived for two items that simulated a web search environment. Their explanatory value for task success was investigated with generalized linear mixed models. Results: The results showed item-specific differences in how frequently specific information processing patterns occurred, with a tendency of individuals not to settle on a single behavior across items. The patterns explained task success beyond reading and evaluation skills, with differences across items as to which patterns were most effective for solving a task correctly. The patterns even partially explained age-related differences. Conclusions: Rule-based process indicators have their strengths and weaknesses. Although dependent on the clarity and precision of a predefined rule, they allow for a targeted examination of behaviors of interest and can potentially support educational intervention during a test session. Concerning adults' digital competencies, our study suggests that the effective use of online information is not inherently based on demographic factors but mediated by central skills of lifelong learning and information processing strategies. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01