Validation of an Automated Procedure for Calculating Core Lexicon From Transcripts.
Purpose: The aim of this study was to advance the use of structured, monologic discourse analysis by validating an automated scoring procedure for core lexicon (CoreLex) using transcripts. Method: Forty-nine transcripts from persons with aphasia and 48 transcripts from persons with no brain injury w...
| Publicado en: | Journal of Speech, Language & Hearing Research Vol. 65; no. 8; pp. 2996 - 3004 |
|---|---|
| Autores principales: | , , , , , , |
| Formato: | Artículo |
| Publicado: |
American Speech-Language-Hearing Association
Aug2022
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=158620628&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 158620628 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 10924388 1SM jtl: Journal of Speech, Language & Hearing Research issn: 10924388 maglogo: N pubinfo: dt: Aug2022 vid: 65 iid: 8 pid: 42 pub: American Speech-Language-Hearing Association artinfo: ui: 158620628 10.1044/2022_JSLHR-21-00473 ppf: 2996 ppct: 8 formats: fmt: @attributes: type: P size: 401KB tig: atl: Validation of an Automated Procedure for Calculating Core Lexicon From Transcripts. aug: au: Dalton, Sarah Grace Stark, Brielle C. Fromm, Davida Apple, Kristen MacWhinney, Brian Rensch, Amanda Rowedder, Madyson affil: Marquette University, Milwaukee, WI Indiana University, Bloomington Carnegie Mellon University, Pittsburgh, PA su: Multilingualism Discourse analysis Experimental design Confidence intervals Research evaluation Research methodology evaluation Research methodology Speech evaluation Automation Statistical correlation Data analysis software Apple computers sug: subj: Multilingualism Discourse analysis Experimental design Confidence intervals Research evaluation Research methodology evaluation Research methodology Speech evaluation Automation Statistical correlation Data analysis software Apple computers ab: Purpose: The aim of this study was to advance the use of structured, monologic discourse analysis by validating an automated scoring procedure for core lexicon (CoreLex) using transcripts. Method: Forty-nine transcripts from persons with aphasia and 48 transcripts from persons with no brain injury were retrieved from the AphasiaBank database. Five structured monologic discourse tasks were scored manually by trained scorers and via automation using a newly developed CLAN command based upon previously published lists for CoreLex. Point-to-point (or word-by-word) accuracy and reliability of the two methods were calculated. Scoring discrepancies were examined to identify errors. Time estimates for each method were calculated to determine if automated scoring improved efficiency. Results: Intraclass correlation coefficients for the tasks ranged from .998 to .978, indicating excellent intermethod reliability. Automated scoring using CLAN represented a significant time savings for an experienced CLAN user and for inexperienced CLAN users following step-by-step instructions. Conclusions: Automated scoring of CoreLex is a valid and reliable alternative to the current gold standard of manually scoring CoreLex from transcribed monologic discourse samples. The downstream time saving of this automated analysis may allow for more efficient and broader utilization of this discourse measure in aphasia research. To further encourage the use of this method, go to https://aphasia.talkbank.org/discourse/CoreLexicon/for materials and the step-by-step instructions utilized in this project. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|