DZDC12: a new multipurpose parallel Algerian Arabizi–French code-switched corpus.

Algeria's socio-linguistic situation is known as a complex phenomenon involving several historical, cultural and technological factors. However, there are three languages that are mainly spoken in Algeria (Arabic, Tamazight and French) and they can be mixed in the same sentence (code-switching). Mor...

Descripción completa

Detalles Bibliográficos
Publicado en:Language Resources & Evaluation Vol. 54; no. 2; pp. 419 - 456
Autor principal: Abainia, Kheireddine
Formato: Artículo
Publicado: Springer Nature Jun2020
Materias:
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=143152355&site=ehost-live
header:
  @attributes:
    shortDbName: hlh
    uiTerm: 143152355
    longDbName: Humanities International Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        1574020X
        179V
      jtl: Language Resources & Evaluation
      issn: 1574020X
      maglogo: N
    pubinfo:
      dt: Jun2020
      vid: 54
      iid: 2
      pid: 237
      pub: Springer Nature
    artinfo:
      ui:
        143152355
        10.1007/s10579-019-09454-8
      ppf: 419
      ppct: 37
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
              size: 2MB
      tig:
        atl: DZDC12: a new multipurpose parallel Algerian Arabizi–French code-switched corpus.
      aug:
        au: Abainia, Kheireddine
        affil: Telecommmunication and Electronics Department, Faculty of Sciences and Technology, Université 8 Mai 1945 Guelma, 24000, Guelma, Algeria
      su:
        Text mining
        Natural language processing
        Sociohistorical analysis
        Corpora
        Sentiment analysis
        Information retrieval
        Algeria
      sug:
        subj:
          Algeria
          Text mining
          Natural language processing
          Sociohistorical analysis
          Corpora
          Sentiment analysis
          Information retrieval
      keyword:
        Algerian dialects
        Arabizi
        Code-switching
        Machine translation
        Parallel corpus
        Text categorization
      ab: Algeria's socio-linguistic situation is known as a complex phenomenon involving several historical, cultural and technological factors. However, there are three languages that are mainly spoken in Algeria (Arabic, Tamazight and French) and they can be mixed in the same sentence (code-switching). Moreover, there are several varieties of dialects that differ from one region to another and sometimes within the same region. This paper aims to provide a new multi-purpose parallel corpus (i.e., DZDC12 corpus), which will serve as a testbed for various natural language processing and information retrieval applications. In particular, it can be a useful tool to study Arabic–French code-switching phenomenon, Algerian Romanized Arabic (Arabizi), different Algerian sub-dialects, sentiment analysis, gender writing style, machine translation, abuse detection, etc. To the best of our knowledge, the proposed corpus is the first of its kind, where the texts are written in Latin script and crawled from Facebook. More specifically, this corpus is organised by gender, region and city, and is transliterated into Arabic script and translated into Modern Standard Arabic. In addition, it is annotated for emotion detection and abuse detection, and annotated at the word level. This article focuses in particular on Algeria's socio-linguistic situation and the effect of social media networks. Furthermore, the general guidelines for the design of DZDC12 corpus are described as well as the dialects clustering over the map.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: Y
      custom: Language Resources & Evaluation is a copyright of Springer, 2020. All Rights Reserved.
      item: Language Resources & Evaluation
      holder: Springer Nature
      dt:
        @attributes:
          year: 2020
    holdings:
      @attributes:
        islocal: N