Textflows: an open science NLP evaluation approach.
Web-based platforms offer suitable experimental environments enabling the construction and reuse of natural language processing (NLP) pipelines. However, systematic evaluation of NLP tools in an open science web-based setting is still a challenge, as suitable experimental environments for the constr...
| Publicado en: | Language Resources & Evaluation Vol. 59; no. 4; pp. 4439 - 4469 |
|---|---|
| Autores principales: | , , , |
| Formato: | Artículo |
| Publicado: |
Springer Nature
Dec2025
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=189912013&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 189912013 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 1574020X 179V jtl: Language Resources & Evaluation issn: 1574020X maglogo: N pubinfo: dt: Dec2025 vid: 59 iid: 4 pid: 237 pub: Springer Nature artinfo: ui: 189912013 10.1007/s10579-024-09793-1 ppf: 4439 ppct: 30 formats: fmt: – @attributes: type: T – @attributes: type: P size: 1.6MB tig: atl: Textflows: an open science NLP evaluation approach. aug: au: Martinc, Matej Perovšek, Matic Lavrač, Nada Pollak, Senja affil: https://ror.org/05060sz93 Department of Knowledge Technologies, Jožef Stefan Institute, Jamova 39, 1000, Ljubljana, Slovenia su: Evaluation methodology Reproducible research Software frameworks Open scholarship Algorithms Computational linguistics sug: subj: Evaluation methodology Reproducible research Software frameworks Open scholarship Algorithms Computational linguistics keyword: NLP evaluation Online platform Open source POS tagging Replicability and reusability ab: Web-based platforms offer suitable experimental environments enabling the construction and reuse of natural language processing (NLP) pipelines. However, systematic evaluation of NLP tools in an open science web-based setting is still a challenge, as suitable experimental environments for the construction and reuse of NLP pipelines are still rare. This paper presents TextFlows, an open-source web-based platform, which enables user-friendly construction, sharing, execution, and reuse of NLP pipelines. It demonstrates that TextFlows can be easily used for systematic evaluation of new NLP components by integrating seven publicly available open-source part of speech (POS) taggers from popular NLP libraries, and evaluating them on six annotated corpora. The integration of new tools into TextFlows supports tools reuse, while the use of precomposed algorithm comparison and evaluation workflows supports experiment reproducibility and testing of future algorithms in the same experimental environment. Finally, to showcase the variety of evaluation possibilities offered in the TextFlows platform, the influence of various factors, such as the training corpus length and the use of pre-trained models, have been tested. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y custom: Language Resources & Evaluation is a copyright of Springer, 2025. All Rights Reserved. item: Language Resources & Evaluation holder: Springer Nature dt: @attributes: year: 2025 holdings: @attributes: islocal: N |
|---|