Machine learning and data analysis for word segmentation of classical Chinese poems: illustrations with Tang and Song examples.
Words are essential parts for understanding classical Chinese poems. We report a collection of 32,399 classical Chinese poems that were annotated with word boundaries. Statistics about the annotated poems support a few heuristic experiences, including the patterns of lines and a practice for the par...
| Publicado en: | Digital Scholarship in the Humanities Vol. 39; no. 1; pp. 228 - 242 |
|---|---|
| Autores principales: | , , , |
| Formato: | Artículo |
| Publicado: |
Oxford University Press / USA
Apr2024
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=176806331&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 176806331 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 2055768X JEO9 jtl: Digital Scholarship in the Humanities issn: 2055768X maglogo: N pubinfo: dt: Apr2024 vid: 39 iid: 1 pid: 622 pub: Oxford University Press / USA artinfo: ui: 176806331 10.1093/llc/fqad073 ppf: 228 ppct: 14 formats: fmt: – @attributes: type: T – @attributes: type: P size: 955KB tig: atl: Machine learning and data analysis for word segmentation of classical Chinese poems: illustrations with Tang and Song examples. aug: au: Liu, Chao-Lin Chang, Wei-Ting Chu, Chang-Ting Zheng, Ti-Yong affil: Department of Computer Science, National Chengchi University , 64 Chih-Nan Road Section 2 , Wen-Shan, Taipei 116011, Taiwan Department of Computer Science and Engineering, University of California at Riverside , 900 University Avenue , Riverside, California 92521, United States Department of Electrical Engineering, National Yang Ming Chiao Tung University , 1001 University Road , East, Hsinchu 300093, Taiwan su: Chinese language Machine learning Data analysis Poetry (Literary form) Chinese literature Music charts sug: subj: Chinese language Machine learning Data analysis Poetry (Literary form) Chinese literature Music charts keyword: classical Chinese poems digital humanities unsupervised learning word segmentation ab: Words are essential parts for understanding classical Chinese poems. We report a collection of 32,399 classical Chinese poems that were annotated with word boundaries. Statistics about the annotated poems support a few heuristic experiences, including the patterns of lines and a practice for the parallel structures (對仗), that researchers of Chinese literature discuss in the literature. The annotators were affiliated with two universities, so they could annotate the poems as independently as possible. Results of an inter-rater agreement study indicate that the annotators have consensus over the identified words 93 per cent of the time and have perfect consensus for the segmentation of a poem 42 per cent of the time. We applied unsupervised classification methods to annotate the poems in several different settings, and evaluated the results with human annotations. Under favorable conditions, the classifier identified about 88 per cent of the words, and segmented poems perfectly 22 per cent of the time. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y custom: © 2019 EADH: The European Association for Digital Humanities. item: Digital Scholarship in the Humanities holder: Oxford University Press / USA dt: @attributes: year: 2024 holdings: @attributes: islocal: N |
|---|