Mechanical Turk data collection in addiction research: utility, concerns and best practices.
Aims: Amazon Mechanical Turk (MTurk) provides a crowdsourcing platform for the engagement of potential research participants with data collection instruments. This review (1) provides an introduction to the mechanics and validity of MTurk research; (2) gives examples of MTurk research; and (3) discu...
| Publicado en: | Addiction Vol. 115; no. 10; pp. 1960 - 1969 |
|---|---|
| Autores principales: | , |
| Formato: | research tables/charts Journal Article |
| Publicado: |
Wiley-Blackwell
Oct2020
|
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=145667457&site=ehost-live header: @attributes: shortDbName: ccm uiTerm: 145667457 longDbName: CINAHL Complete uiTag: AN controlInfo: bkinfo: dissinfo: jinfo: jid: 09652140 AIO jtl: Addiction issn: 09652140 maglogo: Y pubinfo: dt: Oct2020 vid: 115 iid: 10 pid: 480 pub: Wiley-Blackwell place: Malden, Massachusetts artinfo: ui: 145667457 145667457 145667457 10.1111/add.15032 145667457 ppf: 1960 ppct: 9 formats: fmt: – @attributes: type: T – @attributes: type: C – @attributes: type: P tig: atl: Mechanical Turk data collection in addiction research: utility, concerns and best practices. aug: au: Mellis, Alexandra M. Bickel, Warren K. affil: Addiction Recovery Research Center, Fralin Biomedical Research Institute at VTC, VA, , USA sug: subj: Research, Medical Analgesics Therapeutic Use Substance Dependence Data Collection Crowdsourcing Instrument Validation Human Surveys Convenience Sample Behavioral Research Funding Source ab: Aims: Amazon Mechanical Turk (MTurk) provides a crowdsourcing platform for the engagement of potential research participants with data collection instruments. This review (1) provides an introduction to the mechanics and validity of MTurk research; (2) gives examples of MTurk research; and (3) discusses current limitations and best practices in MTurk research. Methods: We review four use cases of MTurk for research relevant to addictions: (1) the development of novel measures, (2) testing interventions, (3) the collection of longitudinal use data to determine the feasibility of longer‐term studies of substance use and (4) the completion of large batteries of assessments to characterize the relationships between measured constructs. We review concerns with the platform, ways of mitigating these and important information to include when presenting findings. Results: MTurk has proved to be a useful source of data for behavioral science more broadly, with specific applications to addiction science. However, it is still not appropriate for all use cases, such as population‐level inference. To live up to the potential of highly transparent, reproducible science from MTurk, researchers should clearly report inclusion/exclusion criteria, data quality checks and reasons for excluding collected data, how and when data were collected and both targeted and actual participant compensation. Conclusions: Although on‐line survey research is not a substitute for random sampling or clinical recruitment, the Mechanical Turk community of both participants and researchers has developed multiple tools to promote data quality, fairness and rigor. Overall, Mechanical Turk has provided a useful source of convenience samples despite its limitations and has demonstrated utility in the engagement of relevant groups for addiction science. pubtype: Academic Journal doctype: research tables/charts Journal Article ougenre: Article language: English refInfo: holdings: @attributes: islocal: N |
|---|