ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks.
Xiaoxia WuHaojun XiaStephen YounZhen ZhengShiyang ChenArash BakhtiariMichael WyattReza Yazdani AminabadiYuxiong HeOlatunji RuwaseLeon SongZhewei YaoPublished in: CoRR (2023)