8-bit Optimizers via Block-wise Quantization.

Tim Dettmers Mike Lewis Sam Shleifer Luke Zettlemoyer

Published in: CoRR (2021)

Keyphrases

block wise
uniform quantization
quantization scheme
order statistics
denoising
subband
signal to noise ratio
bi level