Training Transformers with 4-bit Integers.

Haocheng Xi Changhao Li Jianfei Chen Jun Zhu

Published in: NeurIPS (2023)

Keyphrases

integer arithmetic
genetic algorithm
training phase
real time
artificial intelligence
multi agent
online learning
training process
data sets
information retrieval
expert systems
small number
training samples
test set
feed forward neural networks