Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks.

Haoyuan Wu Haisheng Zheng Bei Yu

Published in: CoRR (2024)

Keyphrases

special case
closely related
database
multimedia
cost effective
parameter settings
search engine
parameter tuning
parameter values
multiple tasks