HLAT: High-quality Large Language Model Pre-trained on AWS Trainium.
Haozheng FanHao ZhouGuangtai HuangParameswaran RamanXinwei FuGaurav GuptaDhananjay RamYida WangJun HuanPublished in: CoRR (2024)
Keyphrases
- language model
- pre trained
- high quality
- language modeling
- training data
- document retrieval
- n gram
- probabilistic model
- training examples
- speech recognition
- retrieval model
- test collection
- query expansion
- ad hoc information retrieval
- information retrieval
- mixture model
- context sensitive
- control signals
- prior knowledge
- smoothing methods
- super resolution
- relevance model
- learning algorithm
- data sets
- neural network
- translation model
- decision trees
- bayesian networks
- high resolution
- relevance feedback
- small number