Inter-rater Agreement Between Exposure Assessment Using Automatic Algorithms and Using Experts.
Objectives To estimate the inter-rater agreement between exposure assessment to asthmagens in current jobs by algorithms based on task-based questionnaires (OccIDEAS) and by experts. Methods Participants in a cross-sectional national survey of exposure to asthmagens (AWES-Asthma) were randomly split...
| Publicado en: | Annals of Work Exposures & Health Vol. 63; no. 1; pp. 45 - 54 |
|---|---|
| Autores principales: | , , , , |
| Formato: | Journal Article |
| Publicado: |
Oxford University Press / USA
Jan2019
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=134228578&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 134228578 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 23987308 KJ1E jtl: Annals of Work Exposures & Health issn: 23987308 maglogo: N pubinfo: dt: Jan2019 vid: 63 iid: 1 pid: 622 pub: Oxford University Press / USA artinfo: ui: 134228578 134228594 10.1093/annweh/wxy084 134228578 ppf: 45 ppct: 9 formats: fmt: – @attributes: type: T – @attributes: type: P tig: atl: Inter-rater Agreement Between Exposure Assessment Using Automatic Algorithms and Using Experts. aug: au: Florath, Ines Fritschi, Lin Glass, Deborah C Rhazi, Mounia Senhaji Parent, Marie-Elise affil: School of Public Health, Curtin University, Perth, Australia sug: subj: Occupational Exposure Algorithms Automation Task Performance and Analysis Asthma, Occupational Diagnosis Clinical Assessment Tools Human Questionnaires Cross Sectional Studies Interrater Reliability Surveys Named Groups by Occupation Random Sample Consensus kappa Statistic Research Personnel ab: Objectives To estimate the inter-rater agreement between exposure assessment to asthmagens in current jobs by algorithms based on task-based questionnaires (OccIDEAS) and by experts. Methods Participants in a cross-sectional national survey of exposure to asthmagens (AWES-Asthma) were randomly split into two subcohorts of equal size. Subcohort 1 was used to determine the most common asthmagen groups and occupational groups. From subcohort 2, a random sample of 200 participants was drawn and current occupational exposure (yes/no) was assessed in these by OccIDEAS and by two experts independently and then as a consensus. Inter-rater agreement was estimated using Cohen's Kappa coefficient. The null hypothesis was set at 0.4, because both the experts and the automatic algorithm assessed the exposure using the same task-based questionnaires and therefore an agreement better than by chance would be expected. Results The Kappa coefficients for the agreement between the experts and the algorithm-based assessments ranged from 0.37 to 1, while the agreement between the two experts ranged from 0.29 to 0.94, depending on the agent being assessed. After discussion by both experts the Kappa coefficients for the consensus decision and OccIDEAS were significantly larger than 0.4 for 7 of the 10 asthmagen groups, while overall the inter-rater agreement was greater than by chance (P < 0.0001). Conclusions The web-based application OccIDEAS is an appropriate tool for automated assessment of current exposure to asthmagens (yes/no), and requires less time-consuming work by highly-qualified research personnel than the traditional expert-based method. Further, it can learn and reuse expert determinations in future studies. pubtype: Academic Journal doctype: Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|