Reproduction, replication, analysis and adaptation of a term alignment approach.
In this paper, we look at the issue of reproducibility and replicability in bilingual terminology alignment (BTA). We propose a set of best practices for reproducibility and replicability of NLP papers and analyze several influential BTA papers from this perspective. Next, we present our attempts at...
| Publicado en: | Language Resources & Evaluation Vol. 54; no. 3; pp. 767 - 801 |
|---|---|
| Autores principales: | , , |
| Formato: | Artículo |
| Publicado: |
Springer Nature
Sep2020
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=144950771&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 144950771 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 1574020X 179V jtl: Language Resources & Evaluation issn: 1574020X maglogo: N pubinfo: dt: Sep2020 vid: 54 iid: 3 pid: 237 pub: Springer Nature artinfo: ui: 144950771 10.1007/s10579-019-09477-1 ppf: 767 ppct: 34 formats: fmt: – @attributes: type: T – @attributes: type: P size: 443KB tig: atl: Reproduction, replication, analysis and adaptation of a term alignment approach. aug: au: Repar, Andraž Martinc, Matej Pollak, Senja affil: Jožef Stefan Postgraduate School, Ljubljana, Slovenia Jožef Stefan Institute, Ljubljana, Slovenia Usher institute, Medical school, University of Edinburgh, Edinburgh, UK su: Computational linguistics Sequence alignment Reproduction Meeting minutes Terms & phrases Best practices Annual meetings sug: subj: Computational linguistics Sequence alignment Reproduction Meeting minutes Terms & phrases Best practices Annual meetings keyword: Bilingual term alignment Cognates Machine learning Reproducibility ab: In this paper, we look at the issue of reproducibility and replicability in bilingual terminology alignment (BTA). We propose a set of best practices for reproducibility and replicability of NLP papers and analyze several influential BTA papers from this perspective. Next, we present our attempts at replication and reproduction, where we focus on a bilingual terminology alignment approach described by Aker et al. (Extracting bilingual terminologies from comparable corpora. In: Proceedings of the 51st annual meeting of the association for computational linguistics, vol. 1 402–411, 2013) who treat bilingual term alignment as a binary classification problem and train an SVM classifier on various dictionary and cognate-based features. Despite closely following the original paper with only minor deviations—in areas where the original description is not clear enough—we obtained significantly worse results than the authors of the original paper. We then analyze the reasons for the discrepancy and describe our attempts at adaptation of the approach to improve the results. Only after several adaptations, we achieve results which are close to the results published in the original paper. Finally, we perform the experiments to verify the replicability and reproducibility of our own code. We publish our code and datasets online to assure the reproducibility of the results of our experiments and implement the selected BTA models in an online platform making them easily reusable even by the technically less-skilled researchers. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y custom: Language Resources & Evaluation is a copyright of Springer, 2020. All Rights Reserved. item: Language Resources & Evaluation holder: Springer Nature dt: @attributes: year: 2020 holdings: @attributes: islocal: N |
|---|