Conceptualization and frequency of sampling (mal)practices in L2 inferential quantitative research: Towards a potential QRP?

Poor sampling practices can constitute a questionable research practice when conducting L2 inferential quantitative research. The current study, a methodological synthesis (N = 433 Scopus/Web of Science (WoS) reports: cluster random sampling) of sampling practices, revealed that L2 inferential quant...

Descripción completa

Detalles Bibliográficos
Publicado en:Journal of Second Language Studies Vol. 8; no. 2; pp. 281 - 313
Autores principales: Vitta, Joseph P., Hahn, Aaron, Canning, Derek, Isbell, Daniel R., Al-Hoorie, Ali H., Nicklin, Christopher
Formato: Artículo
Publicado: John Benjamins Publishing Co. 2025
Materias:
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=190241048&site=ehost-live
header:
  @attributes:
    shortDbName: hlh
    uiTerm: 190241048
    longDbName: Humanities International Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        25423835
        LA6P
      jtl: Journal of Second Language Studies
      issn: 25423835
      maglogo: N
    pubinfo:
      dt: 2025
      vid: 8
      iid: 2
      pid: 11093
      pub: John Benjamins Publishing Co.
    artinfo:
      ui:
        190241048
        10.1075/jsls.00049.vit
      ppf: 281
      ppct: 32
      formats:
      tig:
        atl: Conceptualization and frequency of sampling (mal)practices in L2 inferential quantitative research: Towards a potential QRP?
      aug:
        au:
          Vitta, Joseph P.
          Hahn, Aaron
          Canning, Derek
          Isbell, Daniel R.
          Al-Hoorie, Ali H.
          Nicklin, Christopher
        affil:
          Waseda University Japan
          Kyushu University Japan
          Seigakuin University Japan
          University of Hawaiʻi at Mānoa United States
          Royal Commission for Jubail and Yanbu Saudi Arabia
          The University of Tokyo Japan
      su:
        Sampling (Process)
        Quantitative research
        Statistical sampling
        Research ethics
        Research methodology
        Effect sizes (Statistics)
      sug:
        subj:
          Sampling (Process)
          Quantitative research
          Statistical sampling
          Research ethics
          Research methodology
          Effect sizes (Statistics)
      keyword:
        L2 methods reform
        L2 research synthesis
        methodological synthesis
        sampling and L2 QRPs
        sampling rigor
      ab: Poor sampling practices can constitute a questionable research practice when conducting L2 inferential quantitative research. The current study, a methodological synthesis (N = 433 Scopus/Web of Science (WoS) reports: cluster random sampling) of sampling practices, revealed that L2 inferential quantitative researchers rarely employed randomized and/or effect size-driven sampling processes with only eight (1.8%) and ten (2.3%) of the reports being respectively satisfactory. Furthermore, just 33.9% of the reports featured multisite (convenience) samples. In models assessing what predicted multisite sampling, whether the report was ISLA-focused (r = −.33, p <.001) or single-authored (r = −.15, p <.001) incurred moderate and weak negative associations. Citation analysis metric values and the Scopus/WoS contrast had no associations. The findings of this study suggest the field's sampling practices have room to improve and guidance for future improvement is offered.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: Y
      dt:
        @attributes:
          year: 2025
    holdings:
      @attributes:
        islocal: N