Investigating interoperable event corpora: limitations of reusability of resources and portability of models.
Studies on the applicability of heterogeneous semantically interoperable corpora are rare. We investigate to what extent reusability (both of systems and of annotations) is entailed by corpora whose interoperability is based on compliance to standards. In particular, we look at event detection in En...
| Publicado en: | Language Resources & Evaluation Vol. 57; no. 3; pp. 1107 - 1138 |
|---|---|
| Autores principales: | , |
| Formato: | Artículo |
| Publicado: |
Springer Nature
Sep2023
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=170029264&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 170029264 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 1574020X 179V jtl: Language Resources & Evaluation issn: 1574020X maglogo: N pubinfo: dt: Sep2023 vid: 57 iid: 3 pid: 237 pub: Springer Nature artinfo: ui: 170029264 10.1007/s10579-023-09643-6 ppf: 1107 ppct: 31 formats: fmt: – @attributes: type: T – @attributes: type: P size: 740KB tig: atl: Investigating interoperable event corpora: limitations of reusability of resources and portability of models. aug: au: Caselli, Tommaso Bos, Johan affil: University of Groningen, Oude Kijk in't Jatstraat, 26, 9712 EK, Groningen, The Netherlands su: Corpora Inpainting sug: subj: Corpora Inpainting keyword: Event detection Portability of systems Reusability of data Semantic interoperability Standards ab: Studies on the applicability of heterogeneous semantically interoperable corpora are rare. We investigate to what extent reusability (both of systems and of annotations) is entailed by corpora whose interoperability is based on compliance to standards. In particular, we look at event detection in English texts, supported by the ISO-TimeML annotation scheme. We run two sets of experiments using a common neural network architecture and extensively evaluate our results on both in-distribution and out-of-distribution settings. In all experimental settings, systems obtain state-of-the-art results on the in-distribution data and underperform out-of-distribution ones, setting limits to the benefits of semantically interoperable corpora. By means of a detailed error analysis, we show that while being compliant to a standard guarantees semantic interoperability, this becomes only a necessary condition for reusability, with factors such as differences in the quality of the annotations having a much stronger impact. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y custom: Language Resources & Evaluation is a copyright of Springer, 2023. All Rights Reserved. item: Language Resources & Evaluation holder: Springer Nature dt: @attributes: year: 2023 holdings: @attributes: islocal: N |
|---|