Domain-oriented Language Pre-training with Adaptive Hybrid Masking and Optimal Transport Alignment.
Denghui ZhangZixuan YuanYanchi LiuHao LiuFuzhen ZhuangHui XiongHaifeng ChenPublished in: CoRR (2021)
Keyphrases
- dynamic programming
- early stopping
- domain specific
- programming language
- optimal solution
- oriented programming
- natural language
- training samples
- image alignment
- adaptive threshold
- artificial neural networks
- supervised learning
- genetic algorithm
- neural network
- language learning
- sequence alignment
- specification language
- formal representation
- machine learning