Asymptotic variability of (multilevel) multirater kappa coefficients.
Agreement studies are of paramount importance in various scientific domains. When several observers classify objects on categorical scales, agreement can be quantified through multirater kappa coefficients. In most statistical packages, the standard error of these coefficients is only available unde...
| Publicado en: | Statistical Methods in Medical Research Vol. 28; no. 10/11; pp. 3012 - 3027 |
|---|---|
| Autor principal: | |
| Formato: | equations & formulas research tables/charts Journal Article |
| Publicado: |
Sage Publications Inc.
Oct/Nov2019
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=138594942&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 138594942 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 09622802 31F jtl: Statistical Methods in Medical Research issn: 09622802 maglogo: Y pubinfo: dt: Oct/Nov2019 vid: 28 iid: 10/11 pid: 344 pub: Sage Publications Inc. place: Thousand Oaks, California artinfo: ui: 138594942 138594942 NLM30132375 138594942 10.1177/0962280218794733 NLM30132375 138594942 ppf: 3012 ppct: 15 formats: tig: atl: Asymptotic variability of (multilevel) multirater kappa coefficients. aug: au: Vanbelle, Sophie affil: Department of Methodology and Statistics, CAPHRI, Maastricht University, The Netherlands sug: subj: Models, Statistical Mathematics Observer Bias Software Reproducibility of Results Programming Languages Human Mental Disorders Diagnosis Validation Studies Comparative Studies Evaluation Research Multicenter Studies ab: Agreement studies are of paramount importance in various scientific domains. When several observers classify objects on categorical scales, agreement can be quantified through multirater kappa coefficients. In most statistical packages, the standard error of these coefficients is only available under the null hypothesis that the coefficient is equal to zero, preventing the construction of confidence intervals in the general case. The aim of this paper is triple. First, simple analytic formulae for the standard error of multirater kappa coefficients will be given in the general case. Second, these formulae will be extended to the case of multilevel data structures. The formulae are based on simple matrix algebra and are implemented in the R package "multiagree". Third, guidelines on the choice between the different mulitrater kappa coefficients will be provided. pubtype: Academic Journal doctype: equations & formulas research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|