A streamlined approach to online linguistic surveys.

More and more researchers in linguistics use large-scale experiments to test hypotheses about the data they research, in addition to more traditional informant work. In this paper we describe a new set of free, open-source tools that allow linguists to post studies online, turktools. These tools all...

Full description

Bibliographic Details
Published in:Natural Language & Linguistic Theory Vol. 34; no. 2; pp. 481 - 496
Main Authors: Erlewine, Michael, Kotek, Hadas
Format: Article
Published: Springer Nature May2016
Subjects:
Online Access:View this record in EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=114515163&site=ehost-live
header:
  @attributes:
    shortDbName: hlh
    uiTerm: 114515163
    longDbName: Humanities International Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        0167806X
        OK6
      jtl: Natural Language & Linguistic Theory
      issn: 0167806X
      maglogo: N
    pubinfo:
      dt: May2016
      vid: 34
      iid: 2
      pid: 237
      pub: Springer Nature
    artinfo:
      ui:
        114515163
        10.1007/s11049-015-9305-9
      ppf: 481
      ppct: 15
      formats:
      tig:
        atl: A streamlined approach to online linguistic surveys.
      aug:
        au:
          Erlewine, Michael
          Kotek, Hadas
        affil:
          National University of Singapore, Singapore Singapore
          McGill University, Montreal Canada
      su:
        Language surveys
        Data extraction
        Linguistics research
        Internet surveys
        Client/server computing
      sug:
        subj:
          Language surveys
          Data extraction
          Linguistics research
          Internet surveys
          Client/server computing
      keyword:
        Amazon Mechanical Turk
        Crowdsourcing
        Experimental methods
        Online surveys
        Software
        Web-based experiments
      ab: More and more researchers in linguistics use large-scale experiments to test hypotheses about the data they research, in addition to more traditional informant work. In this paper we describe a new set of free, open-source tools that allow linguists to post studies online, turktools. These tools allow for the creation of a wide range of linguistic tasks, including grammaticality surveys, sentence completion tasks, and picture-matching tasks, allowing for easily implemented large-scale linguistic studies. Our tools further help streamline the design of such experiments and assist in the extraction and analysis of the resulting data. Surveys created using the tools described in this paper can be posted on Amazon's Mechanical Turk service, a popular crowdsourcing platform that mediates between 'Requesters' who can post surveys online and 'Workers' who complete them. This allows many linguistic surveys to be completed within hours or days and at relatively low costs. Alternatively, researchers can host these randomized experiments on their own servers using a supplied server-side component.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: Y
      dt:
        @attributes:
          year: 2016
    holdings:
      @attributes:
        islocal: N