Reproducibility in Small-N Treatment Research: A Tutorial Using Examples From Aphasiology.
Purpose: Small-N studies are the dominant study design supporting evidencebased interventions in communication science and disorders, including treatments for aphasia and related disorders. However, there is little guidance for conducting reproducible analyses or selecting appropriate effect sizes i...
| Publicado en: | Journal of Speech, Language & Hearing Research Vol. 66; no. 6; pp. 1908 - 1928 |
|---|---|
| Autores principales: | , , , , , , , |
| Formato: | Artículo |
| Publicado: |
American Speech-Language-Hearing Association
Jun2023
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=164422014&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 164422014 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 10924388 1SM jtl: Journal of Speech, Language & Hearing Research issn: 10924388 maglogo: N pubinfo: dt: Jun2023 vid: 66 iid: 6 pid: 42 pub: American Speech-Language-Hearing Association artinfo: ui: 164422014 10.1044/2022_JSLHR-22-00333 ppf: 1908 ppct: 20 formats: fmt: @attributes: type: P size: 1.5MB tig: atl: Reproducibility in Small-N Treatment Research: A Tutorial Using Examples From Aphasiology. aug: au: Cavanaugh, Robert Quiqu, Yina M. Swiderski, Alexander M. Kallhoff, Lydia Terhorst, Lauren Wambaugh, Julie Hula, William D. Evans, William S. affil: Department of Communication Science and Disorders, University of Pittsburgh, PA. Audiology and Speech Pathology Program, VA Pittsburgh Healthcare System, PA. Department of Communication Sciences and Disorders, University of Utah, Salt Lake City. Center for Education in Health Sciences and Shirley Ryan Ability Lab, Northwestern University, Evanston, IL. Center for Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA. Department of Occupational Therapy, University of Pittsburgh, PA. su: Medical research Experimental design Research evaluation Regression analysis Aphasia Quality assurance Probability theory Evaluation sug: subj: Medical research Research and Development in the Physical, Engineering, and Life Sciences (except Biotechnology) Experimental design Research evaluation Regression analysis Aphasia Quality assurance Probability theory Evaluation ab: Purpose: Small-N studies are the dominant study design supporting evidencebased interventions in communication science and disorders, including treatments for aphasia and related disorders. However, there is little guidance for conducting reproducible analyses or selecting appropriate effect sizes in small-N studies, which has implications for scientific review, rigor, and replication. This tutorial aims to (a) demonstrate how to conduct reproducible analyses using effect sizes common to research in aphasia and related disorders and (b) provide a conceptual discussion to improve the reader’s understanding of these effect sizes. Method: We provide a tutorial on reproducible analyses of small-N designs in the statistical programming language R using published data from Wambaugh et al. (2017). In addition, we discuss the strengths, weaknesses, reporting requirements, and impact of experimental design decisions on effect sizes common to this body of research. Results: Reproducible code demonstrates implementation and comparison of within-case standardized mean difference, proportion of maximal gain, tau-U, and frequentist and Bayesian mixed-effects models. Data, code, and an interactive web application are available as a resource for researchers, clinicians, and students. Conclusions: Pursuing reproducible research is key to promoting transparency in small-N treatment research. Researchers and clinicians must understand the properties of common effect size measures to make informed decisions in order to select ideal effect size measures and act as informed consumers of small-N studies. Together, a commitment to reproducibility and a keen understanding of effect sizes can improve the scientific rigor and synthesis of the evidence supporting clinical services in aphasiology and in communication sciences and disorders more broadly. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|