Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

26

Full-text search

Active filters: Llama3.2

prithivMLmods/Llama-Doctor-3.2-3B-Instruct-GGUF

Text Generation • Updated Dec 8, 2024 • 1.3k • 11

prithivMLmods/Llama-Song-Stream-3B-Instruct

Text Generation • Updated 23 days ago • 83 • 10

prithivMLmods/Llama-Song-Stream-3B-Instruct-GGUF

Text Generation • Updated 26 days ago • 382 • 9

prithivMLmods/Llama-Chat-Summary-3.2-3B

Text Generation • Updated 26 days ago • 400 • 8

mradermacher/Llama-Song-Stream-3B-Instruct-GGUF

Updated 25 days ago • 329 • 1

prithivMLmods/Llama-Sentient-3.2-3B-Instruct

Text Generation • Updated Dec 10, 2024 • 67 • 10

prithivMLmods/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 24, 2024 • 776 • 10

QuantFactory/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 25, 2024 • 212 • 2

mradermacher/Llama-Sentient-3.2-3B-Instruct-GGUF

Updated Nov 28, 2024 • 85

mradermacher/Llama-Sentient-3.2-3B-Instruct-i1-GGUF

Updated Nov 28, 2024 • 52

bartowski/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 26, 2024 • 104 • 3

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated 28 days ago • 31

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 28 days ago • 33

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated 28 days ago • 29

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 28 days ago • 34

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated 28 days ago • 34

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 28 days ago • 23

mradermacher/Llama-Chat-Summary-3.2-3B-GGUF

Updated 26 days ago • 241

bartowski/Llama-Chat-Summary-3.2-3B-GGUF

Text Generation • Updated 25 days ago • 681

bartowski/Llama-Song-Stream-3B-Instruct-GGUF

Text Generation • Updated 20 days ago • 2.92k

Triangle104/Llama-Chat-Summary-3.2-3B-Q4_K_S-GGUF

Text Generation • Updated 14 days ago • 26

Triangle104/Llama-Chat-Summary-3.2-3B-Q4_K_M-GGUF

Text Generation • Updated 14 days ago • 29

Triangle104/Llama-Chat-Summary-3.2-3B-Q5_K_S-GGUF

Text Generation • Updated 14 days ago • 26

Triangle104/Llama-Chat-Summary-3.2-3B-Q5_K_M-GGUF

Text Generation • Updated 14 days ago • 27

Triangle104/Llama-Chat-Summary-3.2-3B-Q6_K-GGUF

Text Generation • Updated 14 days ago • 24

Triangle104/Llama-Chat-Summary-3.2-3B-Q8_0-GGUF

Text Generation • Updated 14 days ago • 27