Rethinking Learning Rate Tuning in the Era of Large Language Models.
Hongpeng JinWenqi WeiXuyu WangWenbin ZhangYanzhao WuPublished in: CogMI (2023)
Keyphrases
- learning rate
- language model
- language modeling
- convergence rate
- document retrieval
- n gram
- probabilistic model
- speech recognition
- learning algorithm
- information retrieval
- rapid convergence
- query expansion
- convergence speed
- test collection
- retrieval model
- ad hoc information retrieval
- multilayer neural networks
- delta bar delta
- adaptive learning rate
- language modelling
- pseudo relevance feedback
- weight vector
- relevance model
- document ranking
- statistical language models
- vector space model
- smoothing methods
- context sensitive
- query terms
- translation model
- query specific
- convergence theorem
- data mining
- hidden markov models
- evolutionary algorithm
- machine learning