Exploring latent states of problem‐solving competence using hidden Markov model on process data.
The response process of problem‐solving items contains rich information about respondents' behaviours and cognitive process in the digital tasks, while the information extraction is a big challenge. The aim of the study is to use a data‐driven approach to explore the latent states and state transiti...
| Published in: | Journal of Computer Assisted Learning Vol. 37; no. 5; pp. 1232 - 1248 |
|---|---|
| Main Authors: | , , , |
| Format: | pictorial research tables/charts Journal Article |
| Published: |
Wiley-Blackwell
Oct2021
|
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=152209131&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 152209131 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 02664909 6M1 jtl: Journal of Computer Assisted Learning issn: 02664909 maglogo: Y pubinfo: dt: Oct2021 vid: 37 iid: 5 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 152209131 150275715 152209131 152209131 10.1111/jcal.12559 152209131 ppf: 1232 ppct: 16 formats: tig: atl: Exploring latent states of problem‐solving competence using hidden Markov model on process data. aug: au: Xiao, Yue He, Qiwei Veldkamp, Bernard Liu, Hongyun affil: Faculty of Psychology, Beijing Normal University, Beijing, China sug: subj: Computerized Educational Testing Competitive Behavior Competency Assessment Problem Solving Mental Processes Models, Educational Hidden Markov Models Human Male Female United States Test Taking Learning Environment Physiological Processes Comparative Studies Cluster Analysis Word Processing Electronic Spreadsheets Item Analysis Wilcoxon Rank Sum Test Kruskal-Wallis Test Post Hoc Analysis Spearman's Rank Correlation Coefficient Latent Structure Analysis Descriptive Statistics Data Analysis Funding Source Male Female ab: The response process of problem‐solving items contains rich information about respondents' behaviours and cognitive process in the digital tasks, while the information extraction is a big challenge. The aim of the study is to use a data‐driven approach to explore the latent states and state transitions underlying problem‐solving process to reflect test‐takers' behavioural patterns, and to investigate how these states and state transitions could be associated with test‐takers' performance. We employed the Hidden Markov Modelling approach to identify test takers' hidden states during the problem‐solving process and compared the frequency of states and/or state transitions between different performance groups. We conducted comparable studies in two problem‐solving items with a focus on the US sample that was collected in PIAAC 2012, and examined the correlation between those frequencies from two items. Latent states and transitions between them underlying the problem‐solving process were identified and found significantly different by performance groups. The groups with correct responses in both items were found more engaged in tasks and more often to use efficient tools to solve problems, while the group with incorrect responses was found more likely to use shorter action sequences and exhibit hesitative behaviours. Consistent behavioural patterns were identified across items. This study demonstrates the value of data‐driven based HMM approach to better understand respondents' behavioural patterns and cognitive transmissions underneath the observable action sequences in complex problem‐solving tasks. Lay Description: What is already known about this topic?: Process data of interactive problem‐solving tasks contains rich information about test‐takers.To extract underlying information from process data is a big challenge. What this paper adds?: The hidden Markov model helps identify latent states underlying problem‐solving process.Different performance groups displayed different behaviour characteristics.A consistent behavioural pattern was observed across problem‐solving items. Implications for practitioners: The use of HMM holds promise in better visualize and understand behaviour patterns in response process.HMM is potential in understanding cognitive transmissions underneath the observable action sequences. pubtype: Academic Journal doctype: pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|