Developing Situated Measures of Science Instruction through an Innovative Electronic Portfolio App for Mobile Devices: Reliability, Validity, and Feasibility

Autor/inn/en	Martínez, José Felipe; Kloser, Matt; Srinivasan, Jayashri; Stecher, Brian; Edelman, Amanda
Titel	Developing Situated Measures of Science Instruction through an Innovative Electronic Portfolio App for Mobile Devices: Reliability, Validity, and Feasibility
Quelle	In: Educational and Psychological Measurement, 82 (2022) 6, S.1180-1202 (23 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Martínez, José Felipe)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/00131644211064923
Schlagwörter	Science Instruction; Academic Standards; Instructional Innovation; Electronic Publishing; Portfolios (Background Materials); Computer Oriented Programs; Reliability; Validity; Feasibility Studies; Handheld Devices; Psychometrics; Secondary School Science; Self Efficacy; Learner Engagement; Error of Measurement; Scores; Summative Evaluation; Formative Evaluation; Generalizability Theory; Performance Based Assessment; Portfolio Assessment; Science Teachers; Middle School Teachers + Suchen Sie Ihr Suchwort? Teaching of science; Science education; Natural sciences Lessons; Naturwissenschaftlicher Unterricht; Educational Innovation; Bildungsinnovation; Elektronisches Publizieren; Computerprogramm; Reliabilität; Gültigkeit; Psychometry; Psychometrie; Self-efficacy; Selbstwirksamkeit; Messfehler; Leistungsermittlung; Portfoliobeurteilung; Science; Teacher; Teachers; Science teacher; Wissenschaft; Lehrer; Lehrerin; Lehrende; Middle school; Middle schools; Mittelschule; Mittelstufenschule
Abstract	Adoption of new instructional standards in science demands high-quality information about classroom practice. Teacher portfolios can be used to assess instructional practice and support teacher self-reflection anchored in authentic evidence from classrooms. This study investigated a new type of electronic portfolio tool that allows efficient capture of classroom artifacts in multimedia formats using mobile devices. We assess the psychometric properties of measures of quality instruction in middle school science classrooms derived from the contents of portfolios collected using this novel tool--with instruction operationalized through dimensions aligned to the Next Generation Science Standards. Results reflect low rater error and adequate reliability for several dimensions, a dominant underlying factor, and significant relations to some relevant concurrent indicators. Although no relation was found to student standardized test scores or course grades, portfolio ratings did relate to student self-efficacy perceptions and enjoyment of science. We examine factors influencing measurement error, and consider the broader implications of the results for assessing the validity of portfolio score interpretations, and the feasibility and potential value of this type of tool for summative and formative uses, in the context of large-scale instructional improvement efforts. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01