Factor analysis can be a useful standard setting tool in a high stakes OSCE assessment.
No method of standard setting for objective structured clinical examinations (OSCEs) is perfect. Using scores aggregated across stations risks allowing students who are incompetent in some core skills to pass an examination, which may not be acceptable for high stakes assessments. To assess the feas...
| Publicado en: | Medical Education Vol. 38; no. 8; pp. 825 - 832 |
|---|---|
| Autores principales: | , , , , |
| Formato: | research Journal Article |
| Publicado: |
Wiley-Blackwell
Aug2004
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=106082399&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 106082399 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 03080110 ESF jtl: Medical Education issn: 03080110 maglogo: Y pubinfo: dt: Aug2004 vid: 38 iid: 8 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 106082399 2009397764 10.1111/j.1365-2929.2004.01821.x NLM15271042 106082399 ppf: 825 ppct: 7 formats: fmt: @attributes: type: P tig: atl: Factor analysis can be a useful standard setting tool in a high stakes OSCE assessment. aug: au: Chesser AM Laing MR Miedzybrodzka ZH Brittenden J Heys SD sug: subj: Education, Medical Standards Educational Measurement Standards Clinical Competence Standards Factor Analysis Reproducibility of Results Human ab: No method of standard setting for objective structured clinical examinations (OSCEs) is perfect. Using scores aggregated across stations risks allowing students who are incompetent in some core skills to pass an examination, which may not be acceptable for high stakes assessments. To assess the feasibility of using a factor analysis of station scores in a high stakes OSCE to derive measures of underlying competencies. A 12-station OSCE was administered to all 192 students in the penultimate undergraduate year at the University of Aberdeen Medical School. Analysis of the correlation table of station scores was used to exclude stations performing unreliably. Factor analysis of the remaining station scores was carried out to characterise the underlying competencies being assessed. Factor scores were used to derive pass/fail cut-off scores for the examination. Four stations were identified as having unpredicted variations in station scores. Analysis of the content of these stations allowed the underlying problems with the station designs to be isolated. Factor analysis of the remaining 8 stations revealed 3 main underlying factors, accounting for 53% of the total variance in scores. These were labelled 'examination skills', 'communication skills' and 'history taking skills'. Factor analysis is a useful tool for characterising and quantifying the skills that are assessed in an OSCE. Standard setting procedures can be used to calculate cut-off scores for each underlying factor. pubtype: Academic Journal doctype: research Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|