From Characters to Words: Hierarchical Pre-trained Language Model for Open-vocabulary Language Understanding.
Li SunFlorian LuisierKayhan BatmanghelichDinei A. F. FlorêncioCha ZhangPublished in: ACL (1) (2023)
Keyphrases
- language model
- language understanding
- out of vocabulary
- pre trained
- n gram
- language modeling
- natural language understanding
- probabilistic model
- speech recognition
- information retrieval
- query expansion
- language processing
- test collection
- training data
- semantic interpretation
- translation model
- statistical language modeling
- multiword
- retrieval model
- dialogue system
- training examples
- spoken dialogue systems
- control signals
- query terms
- general knowledge
- keywords
- natural language
- word segmentation
- unsupervised learning