Improving Visual Inspection, Interrater Agreement, and Standardization with the Graphic Variability Quotient.

Visual interpretation of slopes (or trend lines) is a source of poor interrater agreement (IRA) of graphed single-subject data. Difficulties with accurate or reliable slope interpretation may be overcome with newly discovered mathematic equations. Three experiments tested applications of the equatio...

Descripción completa

Detalles Bibliográficos
Publicado en:Psychological Record Vol. 73; no. 1; pp. 75 - 97
Autores principales: Kinney, Chad, Weatherly, Nicholas, Burns, Gary, Nicholson, Katie
Formato: Artículo
Publicado: Springer Nature Mar2023
Materias:
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=162728077&site=ehost-live
header:
  @attributes:
    shortDbName: ssf
    uiTerm: 162728077
    longDbName: Social Sciences Full Text (H.W. Wilson)
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        00332933
        PSD
      jtl: Psychological Record
      issn: 00332933
      maglogo: N
    pubinfo:
      dt: Mar2023
      vid: 73
      iid: 1
      pid: 237
      pub: Springer Nature
    artinfo:
      ui:
        162728077
        10.1007/s40732-022-00522-0
      ppf: 75
      ppct: 22
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
              size: 1.8MB
      tig:
        atl: Improving Visual Inspection, Interrater Agreement, and Standardization with the Graphic Variability Quotient.
      aug:
        au:
          Kinney, Chad
          Weatherly, Nicholas
          Burns, Gary
          Nicholson, Katie
        affil: Behavior Analysis, Florida Institute of Technology, School of Behavior Analysis, 150 West University Blvd, 32901, Melbourne, FL, USA
      su:
        Inspection & review
        Standardization
        Graphic design
        Visual aids
        Control groups
      sug:
        subj:
          Inspection & review
          Standardization
          Graphic design
          Visual aids
          Control groups
      keyword:
        Interrater agreement
        Meta-analysis
        Scale
        Single-case design
        Single-subject research
        Slope
        Standard GVQ
        Time-series graphs
        Visual analysis
        Interrater agreement
        Meta-analysis
        Scale
        Single-case design
        Single-subject research
        Slope
        Standard GVQ
        Time-series graphs
        Visual analysis
      ab: Visual interpretation of slopes (or trend lines) is a source of poor interrater agreement (IRA) of graphed single-subject data. Difficulties with accurate or reliable slope interpretation may be overcome with newly discovered mathematic equations. Three experiments tested applications of the equations and demonstrated the following results: (1) manipulation of axis scaling (represented by a single numerical value called "GVQ": Graphic Variability Quotient) strongly predicts the accuracy of behavior change (slope) ratings, β =.895, R =.801; (2) validation of a practical method for determining standard GVQ values was achieved (standardization is critical for reliable visual interpretation and comparison of data across graphs with uniquely constructed axes); and (3) a nonexpert group who received visual aids to rate slopes (degrees of a trend's angle and a "slope change guide") had significantly higher IRA (α =.956) than a control group that was using only predrawn trend lines, F(25, 27) = 3.11, p =.002, d =.49. The discussion explores how the results could become a basis for setting future standards in visual analysis that GVQ empirically and mathematically supports. Incorporating GVQ into graphic design and analysis can potentially improve IRA, improve measures of effect size that directly correspond with visual analysis, and facilitate between-study comparison of graphed single-subject data (in systematic reviews and meta-analyses).
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: N
    holdings:
      @attributes:
        islocal: N