---
base_model: nvidia/Llama-3.1-Minitron-4B-Width-Base
license: other
license_name: nvidia-open-model-license
license_link: >-
  https://developer.download.nvidia.com/licenses/nvidia-open-model-license-agreement-june-2024.pdf
inference: false
---

# Llama-3.1-Minitron-4B-Width-Base

ExLlamav2 8 bpw quant of https://huggingface.co/nvidia/Llama-3.1-Minitron-4B-Width-Base