8-bit Optimizers via Block-wise Quantization.

Tim Dettmers Mike Lewis Sam Shleifer Luke Zettlemoyer

Published in: ICLR (2022)

Keyphrases

block wise
uniform quantization
quantization scheme
ground truth
order statistics
image processing
high quality
image compression
image blocks