20 years of interactive tasks in large‐scale assessments: Process data as a way towards sustainable change?
Background: Over the last 20 years, educational large‐scale assessments have undergone dramatic changes moving away from simple paper‐pencil assessments to innovative, technology‐based assessments. This comprehensive switch has led to some rather technical improvements such as identifying early gues...
| Published in: | Journal of Computer Assisted Learning Vol. 39; no. 6; pp. 1852 - 1860 |
|---|---|
| Main Authors: | , , |
| Format: | tables/charts Journal Article |
| Published: |
Wiley-Blackwell
Dec2023
|
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=173586093&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 173586093 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 02664909 6M1 jtl: Journal of Computer Assisted Learning issn: 02664909 maglogo: Y pubinfo: dt: Dec2023 vid: 39 iid: 6 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 173586093 164641220 173586093 173586093 10.1111/jcal.12847 173586093 ppf: 1852 ppct: 8 formats: tig: atl: 20 years of interactive tasks in large‐scale assessments: Process data as a way towards sustainable change? aug: au: Stadler, Matthias Brandl, Laura Greiff, Samuel affil: Department of Psychology, Ludwig Maximilians University Munich, Munich, Germany sug: subj: Educational Technology Data Analysis Student Performance Appraisal ab: Background: Over the last 20 years, educational large‐scale assessments have undergone dramatic changes moving away from simple paper‐pencil assessments to innovative, technology‐based assessments. This comprehensive switch has led to some rather technical improvements such as identifying early guessing or improving standardization. Objectives: At the same time, process data on student interaction with items has been shown to carry value for obtaining, reporting, and interpreting additional results on student skills in international comparisons. In fact, on the basis of innovative simulated assessment environments, news about student rankings, under‐ and overperforming countries, and novel ideas on how to improve educational systems are prominently featured in the media. At the same time, few of these efforts have been used in a sustainable way to create new knowledge (i.e., on a scientific level), to improve learning and instruction (i.e., on a practical level), and to provide actionable advice to political stakeholders (i.e., on a policy level). Methods: This paper will adopt a meta‐perspective and discuss recent and current developments with a focus on these three perspectives. There will be a particular emphasis on new assessment environments that have been recently employed in large‐scale assessments. Results and Conclusions: Most findings remain very task specific. We propose a necessary steps that need to be taken in order to yield sustainable change from analysing process data on all three levels. Implications: New technologies might be capable of contributing to the research‐policy‐practitioner gap when it comes to utilizing the results from large‐scale assessments to increase the quality of education around the globe but this will require a more systematic approach towards researching them. Lay Description: What is already known about this topic: Technology added new possibilities to educational large‐scale assessmentNext to conventional tasks, new interactive tasks were introduced to measure problem‐solving competenciesThis transition to computerized assessment and interactive tasks allowed analysing behavioural processes in addition to correct or incorrect responses What this paper adds: In this paper we argue that the enormous potential of analysing behavioural processes from interactive tasks is not fully used to yield sustainable change in educationWhile analysing behavioural data has led to substantial advances in measurement quality, much of this research has been atheoretical and difficult to replicate Implications for practice and/or policy: We propose necessary steps for research on behavioural processes from interactive tasks necessary to yield sustainable change on a scientific, practical and political level pubtype: Academic Journal doctype: tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|