Login / Signup

MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models.

Tongxu LuoJiahe LeiFangyu LeiWeihao LiuShizhu HeJun ZhaoKang Liu
Published in: CoRR (2024)
Keyphrases
  • language model
  • fine tuning
  • n gram
  • probabilistic model
  • mixture model
  • language modeling
  • speech recognition
  • document retrieval
  • fine tuned
  • information retrieval
  • test collection
  • language modelling