Semiotically-grounded distant viewing of diagrams: insights from two multimodal corpora.

In this article, we argue for the benefits of combining large-scale analyses of visual materials currently pursued within digital humanities with insights from multimodality research, which is an emerging discipline that studies how human communication relies on appropriate combinations of expressiv...

Descripción completa

Detalles Bibliográficos
Publicado en:Digital Scholarship in the Humanities Vol. 37; no. 2; pp. 405 - 426
Autores principales: Hiippala, Tuomo, Bateman, John A
Formato: Artículo
Publicado: Oxford University Press / USA Jun2022
Materias:
Acceso en línea:Ver este registro en EBSCOhost
fields @attributes:
  recordID: 1
pdfLink:
plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=157821891&site=ehost-live
header:
  @attributes:
    shortDbName: hlh
    uiTerm: 157821891
    longDbName: Humanities International Complete
    uiTag: AN
  controlInfo:
    bkinfo:
    jinfo:
      jid:
        2055768X
        JEO9
      jtl: Digital Scholarship in the Humanities
      issn: 2055768X
      maglogo: N
    pubinfo:
      dt: Jun2022
      vid: 37
      iid: 2
      pid: 622
      pub: Oxford University Press / USA
    artinfo:
      ui:
        157821891
        10.1093/llc/fqab063
      ppf: 405
      ppct: 21
      formats:
        fmt:
          – @attributes:
              type: T
          – @attributes:
              type: P
              size: 1.6MB
      tig:
        atl: Semiotically-grounded distant viewing of diagrams: insights from two multimodal corpora.
      aug:
        au:
          Hiippala, Tuomo
          Bateman, John A
        affil:
          Department of Languages, University of Helsinki , Helsinki, Finland
          Department of English, Universität Bremen, Germany and Department of Linguistics, Universität Bremen , Germany
      su:
        Corpora
        Digital humanities
        Coding theory
        Materials analysis
        Metadata
      sug:
        subj:
          Corpora
          Digital humanities
          Coding theory
          Materials analysis
          Metadata
      ab: In this article, we argue for the benefits of combining large-scale analyses of visual materials currently pursued within digital humanities with insights from multimodality research, which is an emerging discipline that studies how human communication relies on appropriate combinations of expressive resources. We show that concepts developed within the field of multimodality research provide appropriate metadata schemes for various modes of expression in large corpora and datasets. We illustrate the proposed approach using a common mode of expression, diagrams, and analyse two recent multimodal diagram corpora using statistical and computational methods. Our results suggest that multimodally-motivated metadata schemes can provide a robust foundation for computational analyses of large corpora and datasets. Even if a corpus or dataset is not designed to support full-blown analyses of multimodal communication, our results imply that multimodality theory can still be used to impose tighter analytical control over a variety of visual materials.
      pubtype: Academic Journal
      doctype: Article
      src: R
    language: English
    refInfo:
    copyright:
      @attributes:
        flag: Y
      custom: © 2019 EADH: The European Association for Digital Humanities.
      item: Digital Scholarship in the Humanities
      holder: Oxford University Press / USA
      dt:
        @attributes:
          year: 2022
    holdings:
      @attributes:
        islocal: N