The Validity of the Assessment Methods in an Undergraduate Psychiatry Module Examination among a Sample of Fourth Year Malaysian Medical Students.
Background: Assessment of medical students' competencies is fundamental in the education of future doctors. An ideal assessment should play an integral role to provide insight into actual competencies as well as to improve overall performance of students. Objective: This study aims to assess the con...
| Published in: | International Medical Journal Vol. 19; no. 4; pp. 347 - 352 |
|---|---|
| Main Authors: | , , , , , |
| Format: | research tables/charts Journal Article |
| Published: |
Japan International Cultural Exchange Foundation
Dec2012
|
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=85041344&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 85041344 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 13412051 23J1 jtl: International Medical Journal issn: 13412051 maglogo: N pubinfo: dt: Dec2012 vid: 19 iid: 4 pid: 29386 pub: Japan International Cultural Exchange Foundation artinfo: ui: 85041344 85041344 108020220 85041344 ppf: 347 ppct: 5 formats: fmt: @attributes: type: P tig: atl: The Validity of the Assessment Methods in an Undergraduate Psychiatry Module Examination among a Sample of Fourth Year Malaysian Medical Students. aug: au: Fong, Chan Lai Sidi, Hatta Mahady, Zaleha A. Mohamad, Nabishah Saini, Suriati Mohamed Bahri Yusoff, Muhamad Saiful affil: Department of Psychiatry, UKM Medical Centre Kuala Lumpur, Malaysia sug: subj: Educational Measurement Validity Psychiatry Education Students, Medical Human Malaysia Retrospective Design Pearson's Correlation Coefficient Linear Regression Descriptive Statistics Academic Medical Centers Purposive Sample Coefficient alpha Confidence Intervals Data Analysis Software ab: Background: Assessment of medical students' competencies is fundamental in the education of future doctors. An ideal assessment should play an integral role to provide insight into actual competencies as well as to improve overall performance of students. Objective: This study aims to assess the convergent, discriminant and predictive validity of the clinical, theory and continuous assessment components of an undergraduate Psychiatry Module examination on the overall examination performance of fourth year medical students in the Psychiatry Module rotation. Method: A retrospective study design on archival records of a medical undergraduate assessment program was done. The target population was fourth year undergraduate medical students in Universiti Kebangsaan Malaysia Medical Centre (n = 127) that took the end of semester Psychiatry Module examination in February 2011 (academic year of 2010/2011) after completing an 8-week Psychiatry Module. The Pearson correlation test was used to determine the discriminant and convergent validity of the assessment tools. The linear regression test was used to evaluate the predictive validity of each assessment tool used to assess medical student performance. Results: Pearson's correlation test showed an acceptable level of convergent and discriminant validity for the theory and continuous assessment components. The clinical component was found to be lacking in convergent validity. There were eight test formats that predicted the overall examination performance of the medical students: OBA, EMQ, KFQ, case write-up, log-book, OSCE 1, OSCE 2 and OSCE 10. The KFQ ( ß = 0.44, p < 0.001) was the most dominant test format assessment tool predicted the overall examination performance followed by EMQ ( ß = 0.21, p < 0.001), OSCE 1 ( ß = 0.16, p < 0.01), case write-up ( ß = 0.15, p < 0.01), log-book ( ß = 0.15, p < 0.05), OSCE ( ß = 0.14, p < 0.01), OBA ( ß = 0.13, p < 0.01) and OSCE 10 ( ß = 0.13, p < 0.01). The cumulative total OSCE mark ( ß = 0.50, p < 0.001) was the most influential assessment component. Conclusion: The assessment methods used in the Psychiatry Module examination had an acceptable level of convergent, discriminant and predictive validity. Nevertheless, the clinical test formats should be relooked and reviewed in line with the assessment principles and the utility of assessment methods to improve its validity in future. pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|