Hugging Face's logo

altomek
/
Llama-3.1-Minitron-4B-Width-Base-Q4_0_4_4-GGUF

GGUF
Model card Files Community
Llama-3.1-Minitron-4B-Width-Base-Q4_0_4_4-GGUF / README.md
altomek's picture
altomek
quants upload
0fd3066 verified
preview code
|
raw
history blame contribute delete
383 Bytes
metadata
base_model: nvidia/Llama-3.1-Minitron-4B-Width-Base
license: other
license_name: nvidia-open-model-license
license_link: >-
  https://developer.download.nvidia.com/licenses/nvidia-open-model-license-agreement-june-2024.pdf
inference: false

Llama-3.1-Minitron-4B-Width-Base

ExLlamav2 8 bpw quant of https://huggingface.co/nvidia/Llama-3.1-Minitron-4B-Width-Base