Studying the history of the Arabic language: language technology and a large-scale historical corpus.

Arabic is a widely-spoken language with a long and rich history, but existing corpora and language technology focus mostly on modern Arabic and its varieties. Therefore, studying the history of the language has so far been mostly limited to manual analyses on a small scale. In this work, we present...

Descripción completa

Detalles Bibliográficos
Publicado en:Language Resources & Evaluation Vol. 53; no. 4; pp. 771 - 806
Autores principales: Belinkov, Yonatan, Magidow, Alexander, Barrón-Cedeño, Alberto, Shmidman, Avi, Romanov, Maxim
Formato: Artículo
Publicado: Springer Nature Dec2019
Materias:
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=139882011&site=ehost-live
header:
  @attributes:
    shortDbName: hlh
    uiTerm: 139882011
    longDbName: Humanities International Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        1574020X
        179V
      jtl: Language Resources & Evaluation
      issn: 1574020X
      maglogo: N
    pubinfo:
      dt: Dec2019
      vid: 53
      iid: 4
      pid: 237
      pub: Springer Nature
    artinfo:
      ui:
        139882011
        10.1007/s10579-019-09460-w
      ppf: 771
      ppct: 35
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
              size: 2MB
      tig:
        atl: Studying the history of the Arabic language: language technology and a large-scale historical corpus.
      aug:
        au:
          Belinkov, Yonatan
          Magidow, Alexander
          Barrón-Cedeño, Alberto
          Shmidman, Avi
          Romanov, Maxim
        affil:
          MIT Computer Science and Artificial Intelligence Laboratory and Harvard John A. Paulson School of Engineering and Applied Sciences, Cambridge, MA, USA
          Department of Modern and Classical Languages and Literatures, University of Rhode Island, 02881, Kingston, RI, USA
          Qatar Computing Research Institute, HBKU, Doha, Qatar
          Department of Hebrew Literature, Bar-Ilan University, 5290002, Ramat Gan, Israel
          Dicta: The Israel Center for Text Analysis, Am ve-Olamo 8, 9546306, Jerusalem, Israel
          Department of History, University of Vienna, Vienna, Austria
      su:
        Historical linguistics
        Language & languages
        Written communication
        Corpora
        Arabic language
      sug:
        subj:
          Historical linguistics
          Language & languages
          Written communication
          Corpora
          Arabic language
      keyword:
        Arabic
        Corpus
        Periodization
        Text reuse
      ab: Arabic is a widely-spoken language with a long and rich history, but existing corpora and language technology focus mostly on modern Arabic and its varieties. Therefore, studying the history of the language has so far been mostly limited to manual analyses on a small scale. In this work, we present a large-scale historical corpus of the written Arabic language, spanning 1400 years. We describe our efforts to clean and process this corpus using Arabic NLP tools, including the identification of reused text. We study the history of the Arabic language using a novel automatic periodization algorithm, as well as other techniques. Our findings confirm the established division of written Arabic into Modern Standard and Classical Arabic, and confirm other established periodizations, while suggesting that written Arabic may be divisible into still further periods of development.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: Y
      custom: Language Resources & Evaluation is a copyright of Springer, 2019. All Rights Reserved.
      item: Language Resources & Evaluation
      holder: Springer Nature
      dt:
        @attributes:
          year: 2019
    holdings:
      @attributes:
        islocal: N