An end-to-end method for palm-leaf manuscript segmentation based on U-Net.
• An end-to-end method named PLM-SegNet was proposed for foreground segmentation. • A desirable performance can be obtained with a small amount of training data. • PLM-SegNet is a fast and accurate method with good generalization ability. As a virtual restoration tool, digital imaging is widely used...
| Published in: | Journal of Cultural Heritage Vol. 63; pp. 169 - 179 |
|---|---|
| Main Authors: | , , , , , , , , |
| Format: | Article |
| Published: |
Elsevier B.V.
Sep2023
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=172043382&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 172043382 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 12962074 KK8 jtl: Journal of Cultural Heritage issn: 12962074 maglogo: N pubinfo: dt: Sep2023 vid: 63 pid: 467 pub: Elsevier B.V. artinfo: ui: 172043382 10.1016/j.culher.2023.08.003 ppf: 169 ppct: 10 formats: tig: atl: An end-to-end method for palm-leaf manuscript segmentation based on U-Net. aug: au: Wang, Yue Tian, Shuai Wen, Ming Ruan, Yuezhe Tao, Qiaotao Zhou, Xiao Gao, Feng Lu, Hongmei Zhang, Zhimin affil: College of Chemistry and Chemical Engineering, Central South University, Changsha, 410083, PR China Chinese Academy of Cultural Heritage, Beijing, 100028, PR China Hunan Key Laboratory for Scientific Archaeology and Conservation Science, Changsha, 410083, PRChina su: Image processing Source code Manuscripts Digital image processing Independent sets sug: subj: Image processing Source code Manuscripts Digital image processing Independent sets keyword: End-to-end Foreground segmentation Palm-leaf manuscript U-Net ab: • An end-to-end method named PLM-SegNet was proposed for foreground segmentation. • A desirable performance can be obtained with a small amount of training data. • PLM-SegNet is a fast and accurate method with good generalization ability. As a virtual restoration tool, digital imaging is widely used to share the patrimony and preserve the original material of ancient documents. However, the captured raw images usually consist of multiple backgrounds, influencing subsequent image processing, especially the damage investigation process. In this study, an end-to-end method named PLM-SegNet was proposed for the p alm- l eaf m anuscript (PLM) seg mentation based on U- Net. Two cameras (Nikon and Sony) were used to capture 83 palm-leaf manuscript images. The images were labeled by the software Labelme and were then cropped into patches with a specific size to train, validate, and test the PLM-SegNet model. The patch was fed into PLM-SegNet, and the foreground distribution map of this patch was obtained. The foreground distribution map of each patch in an image was predicted and stitched together into one global foreground distribution map. With assistance from the distribution map, the PLM can be segmented from the image easily. The results on two independent test sets showed pixel accuracy of 99.73% and 98.36%, intersection over union (IoU) of 99.42% and 98.31%, Recall of 99.68% and 99.95%, and F1-Score of 99.70% and 99.15% could be achieved, respectively. Additionally, damage detection was adopted as a case study to show the significance of PLM-SegNet. Compared with the raw PLM images, the performance of damage detection on segmented PLM images was improved by 15.00% and 19.33% on F1-Score and IoU, respectively. The results show that PLM-SegNet is a precise and automated method for palm-leaf manuscript segmentation when the labeled training data is limited. The source code is available at https://github.com/Ryan21wy/PLM-SegNet. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y dt: @attributes: year: 2023 holdings: @attributes: islocal: N |
|---|