hugging-quants
/

Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

alvarobartt HF staff commited on Jul 23

Commit

f2a10bb

•

1 Parent(s): cf6dd6c

Update `NOTE` to `IMPORTANT`

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -17,8 +17,8 @@ tags:
 - autoawq
 ---
-> [!NOTE]
-> Note that this is a community driven quantized version of the original model [`meta-llama/Meta-Llama-3.1-405B-Instruct`](https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct) which is the FP16 half-precision official version released by Meta AI.
 ## Model Information

 - autoawq
 ---
+> [!IMPORTANT]
+> This repository is a community-driven quantized version of the original model [`meta-llama/Meta-Llama-3.1-405B-Instruct`](https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct) which is the FP16 half-precision official version released by Meta AI.
 ## Model Information