GGUFs
Collection
quantized models
•
191 items
•
Updated
•
2
'Make knowledge free for everyone'
Quantized version of: neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4
- Downloads last month
- 18
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.
Model tree for DevQuasar/neuralmagic.Sparse-Llama-3.1-8B-ultrachat_200k-2of4-GGUF
Base model
meta-llama/Llama-3.1-8B
Finetuned
neuralmagic/Sparse-Llama-3.1-8B-2of4