Here are a few GGUF(v2) quantizations of the model pankajmathur/orca_mini_3b

Downloads last month: 573

GGUF

Model size

3.43B params

Architecture

llama

4-bit

5-bit

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Aryanne
/

Orca-Mini-3B-gguf

Datasets used to train Aryanne/Orca-Mini-3B-gguf

Spaces using Aryanne/Orca-Mini-3B-gguf 6