altomek
/

Llama-3.2-3B-Instruct-GGUF

Text Generation

Model card Files Files and versions Community

Edit model card

Llama-3.2-3B-Instruct

Selected GGUF quants of https://huggingface.co/alpindale/Llama-3.2-3B-Instruct

Downloads last month: 89

GGUF

Model size

3.21B params

Architecture

llama

4-bit

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/Llama-3.2-3B-Instruct-GGUF

Base model

alpindale/Llama-3.2-3B-Instruct

Quantized

(5)

this model

Collection including altomek/Llama-3.2-3B-Instruct-GGUF

Quants for ARM

8 items • Updated Oct 14