---
base_model: "deepseek-ai/DeepSeek-R1-Distill-Llama-8B"
language:
  - en
tags:
  - transformers
  - safetensors
  - llama
  - text-generation
  - conversational
  - autotrain_compatible
  - text-generation-inference
  - endpoints_compatible
  - region:us
license: "unknown"
inference: false
quantized_by: pbatra
---

# DeepSeek-R1-Distill-Llama-8B

This repository contains quantized versions of the model from the original repository: [deepseek-ai/DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B).

| Name | Quantization Method | Size (GB) |
|------|---------------------|-----------|
| deepseek-r1-distill-llama-8b.Q8_0.gguf | q8_0 | 7.95 |
| deepseek-r1-distill-llama-8b.Q4_0.gguf | q4_0 | 4.34 |