Login / Signup

Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity.

Lu YinYou WuZhenyu ZhangCheng-Yu HsiehYaqing WangYiling JiaMykola PechenizkiyYi LiangZhangyang WangShiwei Liu
Published in: CoRR (2023)
Keyphrases
  • sparse representation
  • wide range
  • high dimensional
  • sparsity constraints
  • machine learning
  • search algorithm
  • expert systems
  • missing values
  • negative matrix factorization
  • pruning algorithm