Rethinking Positional Encoding in Language Pre-training.
Guolin KeDi HeTie-Yan LiuPublished in: CoRR (2020)
Keyphrases
- programming language
- fractal image compression
- training set
- language learning
- natural language
- training phase
- e learning
- training algorithm
- image compression
- target language
- vector quantization
- training examples
- online learning
- information retrieval
- software engineering
- learning process
- learning environment
- artificial intelligence