Leveraging feedback mechanisms to improve the quality of objective structured clinical examinations in Singapore: an exploratory action research study.
Purpose: Variability in examiner scoring threatens the fairness and reliability of objective structured clinical examinations (OSCEs). While examiner standardization exists, there is currently no structured, psychometric-informed, individualized feedback mechanism for examiners. This study explored...
| Publicado en: | Journal of Educational Evaluation for Health Professions Vol. 22; pp. 1 - 9 |
|---|---|
| Autores principales: | , , |
| Formato: | pictorial research tables/charts Journal Article |
| Publicado: |
National Health Personnel Licensing Examination Board
2025
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=192170963&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 192170963 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 19755937 B0CC jtl: Journal of Educational Evaluation for Health Professions issn: 19755937 maglogo: N pubinfo: dt: 2025 vid: 22 pid: 58691 pub: National Health Personnel Licensing Examination Board artinfo: ui: 192170963 192170963 192170963 10.3352/jeehp.2025.22.28 192170963 ppf: 1 ppct: 8 formats: fmt: @attributes: type: P tig: atl: Leveraging feedback mechanisms to improve the quality of objective structured clinical examinations in Singapore: an exploratory action research study. aug: au: Jillian Yeo, Han Ting Samarasekera, Dujeepa Dasharatha Dean, Michael affil: Centre for Medical Education (CenMED), Yong Loo Lin School of Medicine, National University of Singapore, Singapore sug: subj: Feedback Quality Improvement Education, Medical Singapore Clinical Competence Evaluation Educational Measurement Human Exploratory Research Action Research Singapore Pilot Studies Psychometrics Thematic Analysis Nomenclature Confidence Self Regulation Semi-Structured Interview Purposive Sample Interview Guides Descriptive Statistics Data Analysis Software ab: Purpose: Variability in examiner scoring threatens the fairness and reliability of objective structured clinical examinations (OSCEs). While examiner standardization exists, there is currently no structured, psychometric-informed, individualized feedback mechanism for examiners. This study explored the feasibility and perceived value of such a mechanism using an action research approach to co-design and iteratively refine examiner feedback reports. Methods: Two exploratory cycles were conducted between November 2023 and June 2024 with phase 4 OSCE examiners at the Yong Loo Lin School of Medicine. In cycle 1, psychometric analyses of examiner scoring for a phase 4 OSCE informed the design of individualized reports, which were evaluated through interviews. Revisions were made to the format of the report and implemented in cycle 2, where examiner responses were again collected. Data were analyzed thematically, supported by reflective logs and field notes. Results: Nine examiners participated in cycle 1 and 7 in cycle 2. In cycle 1, examiners highlighted challenges in interpreting complex terminology, leading to report refinements such as glossaries and visual graphs. In cycle 2, examiners demonstrated greater confidence in applying feedback, requested longitudinal reports, and shifted from initial resistance to reflective engagement. Across cycles, the reports improved credibility, neutrality, and examiner self-regulation. Conclusion: This exploratory study suggests that psychometric-informed feedback reports can facilitate examiner reflection and transparency in OSCEs. While the findings highlight feasibility and examiner acceptance, longitudinal delivery of feedback, collection of quantitative outcome data, and larger samples are needed to establish whether such reports improve scoring consistency and assessment fairness. pubtype: Academic Journal doctype: pictorial research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|