Mixture-of-Skills: Learning to Optimize Data Usage for Fine-Tuning Large Language Models.

Minghao Wu Thuy-Trang Vu Lizhen Qu Gholamreza Haffari

Published in: CoRR (2024)

Keyphrases

language model
fine tuning
information retrieval
training data
n gram
language modelling
machine learning
fine tune
vector space model
language modeling
test collection
speech recognition
query expansion
em algorithm
knowledge discovery
active learning
decision trees