Cover Image
QR Code

How to meta-analyze coefficient-of-stability estimates: some recommendations based on Monte Carlo studies.

Reliability generalization studies have provided estimates of the mean reliability coefficients and examined factors that explain the variability in the reliability estimates across studies for many different tests and measures. Different authors have used different data analyses to do such meta-ana...

Full description

Published in:Educational & Psychological Measurement Vol. 67; no. 5; pp. 765 - 784
Main Authors: Mason C, Allam R, Brannick MT
Format: equations & formulas research tables/charts Journal Article
Published: Sage Publications Inc. Oct2007
Online Access:View this record in EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=105969427&site=ehost-live
header:
  @attributes:
    shortDbName: ccm
    uiTerm: 105969427
    longDbName: CINAHL Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    dissinfo:
    jinfo:
      jid:
        00131644
        EPM
      jtl: Educational & Psychological Measurement
      issn: 00131644
      maglogo: Y
    pubinfo:
      dt: Oct2007
      vid: 67
      iid: 5
      pid: 344
      pub: Sage Publications Inc.
      place: Thousand Oaks, California
    artinfo:
      ui:
        105969427
        105969427
        2009702338
        10.1177/0013164407301532
        105969427
      ppf: 765
      ppct: 19
      formats:
      tig:
        atl: How to meta-analyze coefficient-of-stability estimates: some recommendations based on Monte Carlo studies.
      aug:
        au:
          Mason C
          Allam R
          Brannick MT
      sug:
        subj:
          Meta Analysis Methods
          Reliability
          Coefficient alpha
          Descriptive Statistics
          Effect Size
          Models, Psychological
          Regression
          Sample Size
          Sampling Error
          Simulations
          Test-Retest Reliability
          Time Factors
          Human
      ab: Reliability generalization studies have provided estimates of the mean reliability coefficients and examined factors that explain the variability in the reliability estimates across studies for many different tests and measures. Different authors have used different data analyses to do such meta-analyses, and little research has addressed whether some methods are more accurate than others. Three methods of meta-analysis for reliability data were compared using Monte Carlo techniques. The meta-analytic methods were those described by Hedges and Vevea, Hunter and Schmidt, and Vacha-Haase. The results suggested that a combination of methods worked best and that Hunter and Schmidt's method should be used to estimate the mean and random-effect variance component, but weighted regression should be used to model continuous moderators.
      pubtype: Academic Journal
      doctype:
        equations & formulas
        research
        tables/charts
        Journal Article
      ougenre: Article
    language: English
    refInfo:
    holdings:
      @attributes:
        islocal: N