Login / Signup

Mitigating Quantization Errors Due to Activation Spikes in GLU-Based LLMs.

Jaewoo YangHayun KimYounghoon Kim
Published in: CoRR (2024)
Keyphrases
  • quantization error
  • quantization noise
  • visual words
  • error diffusion
  • additive noise
  • machine learning
  • reconstruction error
  • multiresolution
  • high quality
  • hidden markov models
  • denoising
  • graphical models