Chinese Informal Word Normalization: an Experimental Study.
Aobo WangMin-Yen KanDaniel AndradeTakashi OnishiKai IshikawaPublished in: IJCNLP (2013)
Keyphrases
- word segmentation
- chinese word segmentation
- chinese text
- unknown words
- n gram
- english chinese
- co occurrence
- english text
- word recognition
- word sense disambiguation
- foreign language
- chinese language
- chinese texts
- preprocessing
- pos tagging
- out of vocabulary
- related words
- word level
- statistical machine translation
- sentence level
- text classification