[7 Jan 2023] ROIC-DM: Robust Text Inference and Classification via Diffusion Model ...
Quantization plays a crucial role in deploying Large Language Models (LLMs) in resource-constrained environments. However, the presence of outlier features significantly hinders low-bit quantization.