GPT3.int8(): 8-bit Matrix Multiplication for Transformers at Scale.

Tim Dettmers Mike Lewis Younes Belkada Luke Zettlemoyer

Published in: NeurIPS (2022)

Keyphrases

matrix multiplication
message passing
scale space
distributed memory