An Empirical Study on Efficiency of a Dictionary Based Viterbi Algorithm for Word Segmentation.
Sudhir AggarwalShiva HoushmandTathagata MukherjeeJames ParsonsPublished in: IEEE BigData (2020)
Keyphrases
- word segmentation
- viterbi algorithm
- n gram
- chinese text retrieval
- language model
- language independent
- word recognition
- hidden markov models
- chinese word segmentation
- language modeling
- word level
- chinese text
- text classification
- cross lingual
- markov model
- pos tagging
- dynamic programming
- document analysis
- association rules
- neural network
- reinforcement learning
- bayesian networks