DETECTION OF MACHINE-TRANSLATED CROATIAN– ENGLISH PHRASES: DO TRANSLATORS AGREE IN THEIR ASSESSMENT?
This study examines the extent to which machine-translated and human-translated Croatian–English phrases can be distinguished by expert evaluators by analysing inter-rater agreement. For this purpose, a parallel corpus was compiled from four Croatian research articles in the fields of Education and...
| Publicado en: | Croatica et Slavica Iadertina Vol. 22; no. 1; pp. 11 - 30 |
|---|---|
| Autores principales: | , |
| Formato: | Artículo |
| Publicado: |
University of Zadar, Department of Croatian & Slavic Studies
2026
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| Sumario: | This study examines the extent to which machine-translated and human-translated Croatian–English phrases can be distinguished by expert evaluators by analysing inter-rater agreement. For this purpose, a parallel corpus was compiled from four Croatian research articles in the fields of Education and Psychology, together with their human translations and machine translations produced using the online tool onlinedoctranslator.com. Two professional translators, native speakers of Croatian with extensive translation experience, were asked to classify selected English translations of Croatian phrases as either machine-translated or human-translated. The analysis shows a raw inter-rater agreement of 75 % for both machine-translated and human-translated phrase sets, indicating a moderate level of agreement between the raters. These results suggest that even expert translators do not consistently reach the same conclusions when judging the origin of short, decontextualised translated phrases. The findings support the view that, at the phrase level, machine-translated output is increasingly difficult to distinguish from human translation on the basis of surface linguistic features alone. U ovom se istraživanju ispituje je li moguće razlikovati strojni prijevod od prijevoda koji je izradio čovjek na primjeru prijevoda hrvatskih izraza na engleski jezik. Analizira se u kojoj mjeri se stručni ocjenjivači slažu u procjeni prijevoda kao strojnoga prijevoda ili prijevoda koji je izradio čovjek. U tu svrhu sastavljen je korpus znanstvenih radova iz područja obrazovanja i psihologije, koji se sastoji od triju potkorpusa: 1. korpus izvornih tekstova na hrvatskome, 2. korpus prijevoda izvornih tekstova na engleski jezik koje je preveo čovjek, 3. korpus strojno prevedenih hrvatskih tekstova na engleski. U zadatku prepoznavanja dva profesionalna prevoditelja, izvorni govornici hrvatskoga, razvrstavala su engleske prijevode odabranih hrvatskih izraza kao strojne ili one koje je preveo čovjek. Slaganje među ocjenjivačima iznosilo je 75 % uz umjerenu podudarnost. Rezultati pokazuju da se prevoditelji ne slažu u potpunosti pri procjeni, što podupire stav da postaje teže razlikovati strojno prevedene izraze od prijevoda koje je izradio čovjek. |
|---|