neuralmagic
/

Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16

Text Generation

compressed-tensors

Model card Files Files and versions Community

nm-research commited on Dec 19, 2024

Commit

0c2a256

·

verified ·

1 Parent(s): ca14676

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -19,6 +19,7 @@ language:
   - **Output:** Text
 - **Model Optimizations:**
   - **Sparsity:** 2:4
 - **Release Date:** 11/21/2024
 - **Version:** 1.0
 - **License(s):** [llama3.1](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B/blob/main/LICENSE)

   - **Output:** Text
 - **Model Optimizations:**
   - **Sparsity:** 2:4
+  - **Weight quantization:** INT4
 - **Release Date:** 11/21/2024
 - **Version:** 1.0
 - **License(s):** [llama3.1](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B/blob/main/LICENSE)