ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks

Published in arXiv preprint arXiv:2312.08583, 2023

Co-author (second author). Studies FP6 quantization for LLMs across diverse generative tasks, complementing the FP6-LLM system work.

Download Paper