scholarly journals Punctuation as Implicit Annotations for Chinese Word Segmentation

2009 ◽  
Vol 35 (4) ◽  
pp. 505-512 ◽  
Author(s):  
Zhongguo Li ◽  
Maosong Sun

We present a Chinese word segmentation model learned from punctuation marks which are perfect word delimiters. The learning is aided by a manually segmented corpus. Our method is considerably more effective than previous methods in unknown word recognition. This is a step toward addressing one of the toughest problems in Chinese word segmentation.

2020 ◽  
Author(s):  
Jinlan Fu ◽  
Pengfei Liu ◽  
Qi Zhang ◽  
Xuanjing Huang

Sign in / Sign up

Export Citation Format

Share Document