Taking PISA Seriously: How Accurate are Low-Stakes Exams?
PISA is seen as the gold standard for evaluating educational outcomes worldwide. Yet, being a low-stakes exam, students may not take it seriously resulting in downward biased scores and inaccurate rankings. This paper provides a method to identify and account for non-serious behavior in low-stakes e...
| Publicado en: | Journal of Labor Research Vol. 42; no. 2; pp. 184 - 244 |
|---|---|
| Autores principales: | , , |
| Formato: | Artículo |
| Publicado: |
Springer Nature
Jun2021
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=151231007&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 151231007 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 01953613 JLR jtl: Journal of Labor Research issn: 01953613 maglogo: N pubinfo: dt: Jun2021 vid: 42 iid: 2 pid: 237 pub: Springer Nature artinfo: ui: 151231007 10.1007/s12122-021-09317-8 ppf: 184 ppct: 60 formats: fmt: – @attributes: type: T – @attributes: type: P size: 3.4MB tig: atl: Taking PISA Seriously: How Accurate are Low-Stakes Exams? aug: au: Akyol, Pelin Krishna, Kala Wang, Jinwen affil: Bilkent University, Ankara, Turkey Penn State University, CES-IFO and NBER, State College, PA, USA Bates White Economic Consulting, Washington, DC, USA su: Programme for International Student Assessment Educational standards Educational outcomes Accounting methods sug: subj: Educational standards Programme for International Student Assessment Administration of Education Programs Educational outcomes Accounting methods keyword: Biased rankings Computer-based assessments Item response data Low-stakes exams PISA Biased rankings Computer-based assessments Item response data Low-stakes exams PISA ab: PISA is seen as the gold standard for evaluating educational outcomes worldwide. Yet, being a low-stakes exam, students may not take it seriously resulting in downward biased scores and inaccurate rankings. This paper provides a method to identify and account for non-serious behavior in low-stakes exams by leveraging information in computer-based assessments in PISA 2015. Our method corrects for non-serious behavior by fully imputing scores for items not taken seriously. We compare the scores/rankings calculated by our method to the scores/rankings calculated by giving zero points to skipped items as well as to the scores/rankings calculated by treating skipped items at the end of the exam as if they were not administered, which is the procedure followed by PISA. We show that a country can improve its ranking by up to 15 places by encouraging its own students to take the exam seriously and that the PISA approach corrects for only about half of the bias generated by the non-seriousness. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|