Paper: [https://arxiv.org/abs/2308.13137](https://arxiv.org/abs/2308.13137) | |
Code: [https://github.com/OpenGVLab/OmniQuant](https://github.com/OpenGVLab/OmniQuant) | |
To run this model, refer [https://github.com/OpenGVLab/OmniQuant/blob/main/runing_falcon180b_on_single_a100_80g.ipynb](https://github.com/OpenGVLab/OmniQuant/blob/main/runing_falcon180b_on_single_a100_80g.ipynb) for more details. |