Sequential OSCE based on item response theory.
Purpose: In sequential Objective Structured Clinical Examination (OSCE) all students initially take a short screening OSCE. Examinees who pass are excused from further testing, but an additional OSCE will be administered for the remaining examinees. Previous investigations on sequential OSCE were ba...
| Published in: | Journal of Educational Evaluation for Health Professions Vol. 14; pp. 1 - 13 |
|---|---|
| Main Authors: | , |
| Format: | research tables/charts Journal Article |
| Published: |
National Health Personnel Licensing Examination Board
2017
|
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=125093971&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 125093971 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 19755937 B0CC jtl: Journal of Educational Evaluation for Health Professions issn: 19755937 maglogo: N pubinfo: dt: 2017 vid: 14 pid: 58691 pub: National Health Personnel Licensing Examination Board artinfo: ui: 125093971 125093971 125093971 10.3352/jeehp.2017.14.19 125093971 ppf: 1 ppct: 12 formats: fmt: @attributes: type: P tig: atl: Sequential OSCE based on item response theory. aug: au: Hejri, Sara Mortaz Jalili, Mohammad affil: Health Professions Education Research Center, Department of Medical Education, Tehran University of Medical Sciences, Tehran, Iran sug: subj: Education, Medical Educational Measurement Evaluation Achievement Tests Evaluation Test Construction Evaluation Human Iran Retrospective Design Nonexperimental Studies Summated Rating Scaling Descriptive Statistics Educational Theory Educational Measurement Economics Funding Source ab: Purpose: In sequential Objective Structured Clinical Examination (OSCE) all students initially take a short screening OSCE. Examinees who pass are excused from further testing, but an additional OSCE will be administered for the remaining examinees. Previous investigations on sequential OSCE were based on the Classical Test Theory. We aimed at designing and evaluating screening OSCEs based on Item Response Theory. Methods: We carried out a retrospective observational study. In each of a 10-station OSCE, the students’ performance was graded on a Likert-type scale. Since data was polytomous, difficulty and discrimination parameters, and students’ ability were calculated by graded response model. To design several screening OSCEs, we identified the five most difficult stations and the five most discriminative ones. Five, four, or three stations were selected for each test. Normal and stringent cut-scores were defined for each test. We compared the results of each 12 screening OSCE to the main OSCE and calculated the positive and negative predictive values (PPV and NPV), as well as the exam cost. Results: 253 students (95.1%) passed the main OSCE. 72.6% to 94.4% of examinees passed the screening tests. The PPV values ranged from 0.98 to 1.00, and the NPV values ranged from 0.18 to 0.59. Two tests effectively predicted the results of the main exam accurately and could result in 34-40% financial saving. Conclusion: Sequential OSCE, if stations with highest values of IRT-based discrimination and stringent cut-scores are applied to the screening test, can be an efficient and convenient way to conduct an OSCE. pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|