Disentangling the Effects of Culture and Language on Measurement Noninvariance in Cross-Cultural Research: The Culture, Comprehension, and Translation Bias (CCT) Procedure.

Comparability of measurement across different cultural groups is an essential prerequisite for any cross-cultural assessment. However, cross-cultural measurement invariance is rarely achieved and detecting the source of noninvariance is often challenging. In particular, when different language versi...

Full description

Bibliographic Details
Published in:Psychological Assessment Vol. 33; no. 5; pp. 375 - 385
Main Authors: Bader, Martina, Jobst, Lisa J., Zettler, Ingo, Hilbig, Benjamin E., Moshagen, Morten
Format: Article
Published: American Psychological Association May2021
Subjects:
Online Access:View this record in EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=161848560&site=ehost-live
header:
  @attributes:
    shortDbName: ssf
    uiTerm: 161848560
    longDbName: Social Sciences Full Text (H.W. Wilson)
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        10403590
        POL
      jtl: Psychological Assessment
      issn: 10403590
      maglogo: N
    pubinfo:
      dt: May2021
      vid: 33
      iid: 5
      pid: 34
      pub: American Psychological Association
    artinfo:
      ui:
        161848560
        10.1037/pas0000989
      ppf: 375
      ppct: 10
      formats:
      tig:
        atl: Disentangling the Effects of Culture and Language on Measurement Noninvariance in Cross-Cultural Research: The Culture, Comprehension, and Translation Bias (CCT) Procedure.
      aug:
        au:
          Bader, Martina
          Jobst, Lisa J.
          Zettler, Ingo
          Hilbig, Benjamin E.
          Moshagen, Morten
        affil:
          Institute of Psychology and Education, Ulm University
          Department of Psychology, University of Copenhagen
          Cognitive Psychology, University of Koblenz-Landau
      su:
        Native language
        Translating & interpreting
        Culture
        Cross-cultural differences
        Computer adaptive testing
        Multiple comparisons (Statistics)
        English language
        Reading intervention
      sug:
        subj:
          Native language
          Translating & interpreting
          Culture
          Cross-cultural differences
          Translation and Interpretation Services
          Computer adaptive testing
          Multiple comparisons (Statistics)
          English language
          Reading intervention
      keyword:
        CCT procedure
        cross-cultural assessment
        dark factor
        item bias
        measurement invariance
        CCT procedure
        cross-cultural assessment
        dark factor
        item bias
        measurement invariance
      ab: Comparability of measurement across different cultural groups is an essential prerequisite for any cross-cultural assessment. However, cross-cultural measurement invariance is rarely achieved and detecting the source of noninvariance is often challenging. In particular, when different language versions of a measure are administered to different cultural groups, noninvariance on certain items may originate either from translation inconsistencies (translation bias) or from actual differences between cultural groups (culture bias). If, on the other hand, a measure is administered in a common language version (e.g., English), item noninvariance may also result from comprehension issues of nonnative speakers (comprehension bias). Here, we outline a procedure suitable for dissociating these sources of item noninvariance, termed the culture, comprehension, and translation bias (CCT) procedure. The CCT procedure is based on a between-subjects design comparing samples from two different cultures who complete a measure in either the same or a different language version. We demonstrate in a simulation study and illustrate in an empirical example with actual cross-cultural data how performing multiple pairwise comparisons across (a) groups differing in culture but not in language, (b) groups differing in language but not in culture, and (c) groups differing in both culture and language allows to pinpoint the source of item noninvariance with high specificity. The CCT procedure thus provides a valuable tool for improving cross-cultural assessment through directing the process of item translation and cultural adaptation. Public Significance Statement: We outline a procedure that allows disentangling potential sources of measurement noninvariance in cross-cultural assessment. By performing multiple pairwise comparisons across groups differing in culture, language, or a combination thereof, the effects on the measurement of cultural differences, translation inconsistencies, or comprehension issues due to completing a version of a measure in one's nonnative language can be assessed.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: N
    holdings:
      @attributes:
        islocal: N