altomek's picture
quants upload
0fd3066 verified
---
base_model: nvidia/Llama-3.1-Minitron-4B-Width-Base
license: other
license_name: nvidia-open-model-license
license_link: >-
https://developer.download.nvidia.com/licenses/nvidia-open-model-license-agreement-june-2024.pdf
inference: false
---
# Llama-3.1-Minitron-4B-Width-Base
ExLlamav2 8 bpw quant of https://huggingface.co/nvidia/Llama-3.1-Minitron-4B-Width-Base