TinyLLM: Learning a Small Student from Multiple Large Language Models.

Yijun Tian Yikun Han Xiusi Chen Wei Wang Nitesh V. Chawla

Published in: CoRR (2024)

Keyphrases

language model
learning process
probabilistic model
statistical language models
active learning
language modeling
recommender systems
knn
information extraction
speech recognition
document retrieval
student learning
language modelling