Application of Change Point Analysis of Response Time Data to Detect Test Speededness.
Computer-based and web-based testing have become increasingly popular in recent years. Their popularity has dramatically expanded the availability of response time data. Compared to the conventional item response data that are often dichotomous or polytomous, response time has the advantage of being...
| Publicado en: | Educational & Psychological Measurement Vol. 82; no. 5; pp. 1031 - 1063 |
|---|---|
| Autores principales: | , |
| Formato: | Artículo |
| Publicado: |
Sage Publications Inc.
Oct2022
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=158571080&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 158571080 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 00131644 EPM jtl: Educational & Psychological Measurement issn: 00131644 maglogo: Y pubinfo: dt: Oct2022 vid: 82 iid: 5 pid: 344 pub: Sage Publications Inc. artinfo: ui: 158571080 10.1177/00131644211046392 ppf: 1031 ppct: 32 formats: tig: atl: Application of Change Point Analysis of Response Time Data to Detect Test Speededness. aug: au: Cheng, Ying Shao, Can affil: University of Notre Dame, Notre Dame, IN, USA Applied Materials Inc, Santa Clara, CA, USA su: Computer simulation Task performance Cognition Psychological tests Fisher exact test Database management Research funding Descriptive statistics Reaction time Statistical models Diagnostic errors Probability theory Evaluation sug: subj: Computer simulation Task performance Cognition Psychological tests Data Processing, Hosting, and Related Services Fisher exact test Database management Research funding Descriptive statistics Reaction time Statistical models Diagnostic errors Probability theory Evaluation keyword: change point analysis intra-individual change log-normal model response time test speededness change point analysis intra-individual change log-normal model response time test speededness ab: Computer-based and web-based testing have become increasingly popular in recent years. Their popularity has dramatically expanded the availability of response time data. Compared to the conventional item response data that are often dichotomous or polytomous, response time has the advantage of being continuous and can be collected in an unobstrusive manner. It therefore has great potential to improve many measurement activities. In this paper, we propose a change point analysis (CPA) procedure to detect test speededness using response time data. Specifically, two test statistics based on CPA, the likelihood ratio test and Wald test, are proposed to detect test speededness. A simulation study has been conducted to evaluate the performance of the proposed CPA procedure, as well as the use of asymptotic and empirical critical values. Results indicate that the proposed procedure leads to high power in detecting test speededness, while keeping the false positive rate under control, even when simplistic and liberal critical values are used. Accuracy of the estimation of the actual change point, however, is highly dependent on the true change point. A real data example is also provided to illustrate the utility of the proposed procedure and its contrast to the response-only procedure. Implications of the findings are discussed at the end. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|