How to construct and implement script concordance tests: insights from a systematic review.
Medical Education 2012: 46: 552-563 Context Programmes of assessment should measure the various components of clinical competence. Clinical reasoning has been traditionally assessed using written tests and performance-based tests. The script concordance test (SCT) was developed to assess clinical da...
| Publicado en: | Medical Education Vol. 46; no. 6; pp. 552 - 564 |
|---|---|
| Autores principales: | , , , |
| Formato: | research systematic review tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Jun2012
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=104448980&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 104448980 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 03080110 ESF jtl: Medical Education issn: 03080110 maglogo: Y pubinfo: dt: Jun2012 vid: 46 iid: 6 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 104448980 75506022 10.1111/j.1365-2923.2011.04211.x NLM22626047 104448980 ppf: 552 ppct: 12 formats: fmt: @attributes: type: P tig: atl: How to construct and implement script concordance tests: insights from a systematic review. aug: au: Dory, Valérie Gagnon, Robert Vanpee, Dominique Charlin, Bernard affil: Fonds de la Recherche Scientifique - FNRS; Institute of Health and Society (IRSS), Université catholique de Louvain, Brussels, Belgium sug: subj: Education, Clinical Decision Making Test Construction Systematic Review Medline ERIC Database Psycinfo Human Data Analysis Software Educational Measurement ab: Medical Education 2012: 46: 552-563 Context Programmes of assessment should measure the various components of clinical competence. Clinical reasoning has been traditionally assessed using written tests and performance-based tests. The script concordance test (SCT) was developed to assess clinical data interpretation skills. A recent review of the literature examined the validity argument concerning the SCT. Our aim was to provide potential users with evidence-based recommendations on how to construct and implement an SCT. Methods A systematic review of relevant databases (MEDLINE, ERIC [Education Resources Information Centre], PsycINFO, the Research and Development Resource Base [RDRB, University of Toronto]) and Google Scholar, medical education journals and conference proceedings was conducted for references in English or French. It was supplemented by ancestry searching and by additional references provided by experts. Results The search yielded 848 references, of which 80 were analysed. Studies suggest that tests with around 100 items (25-30 cases), of which 25% are discarded after item analysis, should provide reliable scores. Panels with 10-20 members are needed to reach adequate precision in terms of estimated reliability. Panellists' responses can be analysed by checking for moderate variability among responses. Studies of alternative scoring methods are inconclusive, but the traditional scoring method is satisfactory. There is little evidence on how best to determine a pass/fail threshold for high-stakes examinations. Conclusions Our literature search was broad and included references from medical education journals not indexed in the usual databases, conference abstracts and dissertations. There is good evidence on how to construct and implement an SCT for formative purposes or medium-stakes course evaluations. Further avenues for research include examining the impact of various aspects of SCT construction and implementation on issues such as educational impact, correlations with other assessments, and validity of pass/fail decisions, particularly for high-stakes examinations. pubtype: Academic Journal doctype: research systematic review tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|