The Costs of Simplicity: Why Multilevel Models May Benefit from Accounting for Cross-Cluster Differences in the Effects of Controls.

Context effects, where a characteristic of an upper-level unit or cluster (e.g., a country) affects outcomes and relationships at a lower level (e.g., that of the individual), are a primary object of sociological inquiry. In recent years, sociologists have increasingly analyzed such effects using qu...

Descripción completa

Detalles Bibliográficos
Publicado en:American Sociological Review Vol. 82; no. 4; pp. 796 - 828
Autores principales: Heisig, Jan Paul, Schaeffer, Merlin, Giesecke, Johannes
Formato: Artículo
Publicado: Sage Publications Inc. Aug2017
Materias:
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=124305327&site=ehost-live
header:
  @attributes:
    shortDbName: ssf
    uiTerm: 124305327
    longDbName: Social Sciences Full Text (H.W. Wilson)
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        00031224
        ASC
      jtl: American Sociological Review
      issn: 00031224
      maglogo: Y
    pubinfo:
      dt: Aug2017
      vid: 82
      iid: 4
      pid: 344
      pub: Sage Publications Inc.
    artinfo:
      ui:
        124305327
        10.1177/0003122417717901
      ppf: 796
      ppct: 32
      formats:
      tig:
        atl: The Costs of Simplicity: Why Multilevel Models May Benefit from Accounting for Cross-Cluster Differences in the Effects of Controls.
      aug:
        au:
          Heisig, Jan Paul
          Schaeffer, Merlin
          Giesecke, Johannes
        affil:
          WZB Berlin Social Science Center
          University of Cologne
          Humboldt University Berlin
      su:
        Sociological research
        Sociology
        Multilevel models
        Context effects (Psychology)
        Cluster analysis (Statistics)
        Robust statistics
        Least squares
        Statistical errors
        Monte Carlo method
        Comparative studies
        Statistical models
        Research methodology
        Research evaluation
        Evaluation
      sug:
        subj:
          Sociological research
          Sociology
          Research and Development in the Social Sciences and Humanities
          Multilevel models
          Context effects (Psychology)
          Cluster analysis (Statistics)
          Robust statistics
          Least squares
          Statistical errors
          Monte Carlo method
          Comparative studies
          Statistical models
          Research methodology
          Research evaluation
          Evaluation
      keyword:
        cluster-robust standard errors
        comparative research
        context effects
        hierarchical data
        multilevel modeling
        cluster-robust standard errors
        comparative research
        context effects
        hierarchical data
        multilevel modeling
      ab: Context effects, where a characteristic of an upper-level unit or cluster (e.g., a country) affects outcomes and relationships at a lower level (e.g., that of the individual), are a primary object of sociological inquiry. In recent years, sociologists have increasingly analyzed such effects using quantitative multilevel modeling. Our review of multilevel studies in leading sociology journals shows that most assume the effects of lower-level control variables to be invariant across clusters, an assumption that is often implausible. Comparing mixed-effects (random-intercept and slope) models, cluster-robust pooled OLS, and two-step approaches, we find that erroneously assuming invariant coefficients reduces the precision of estimated context effects. Semi-formal reasoning and Monte Carlo simulations indicate that loss of precision is largest when there is pronounced cross-cluster heterogeneity in the magnitude of coefficients, when there are marked compositional differences among clusters, and when the number of clusters is small. Although these findings suggest that practitioners should fit more flexible models, illustrative analyses of European Social Survey data indicate that maximally flexible mixed-effects models do not perform well in real-life settings. We discuss the need to balance parsimony and flexibility, and we demonstrate the encouraging performance of one prominent approach for reducing model complexity.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: N
    holdings:
      @attributes:
        islocal: N