Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,952

Full-text search

Active filters: facebook

meta-llama/Llama-3.2-1B-Instruct-QLORA_INT4_EO8

Text Generation • Updated Nov 18, 2024 • 1.07k • 34

meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8

Text Generation • Updated Nov 18, 2024 • 775 • 26

meta-llama/Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8

Text Generation • Updated Nov 18, 2024 • 585 • 31

c01zaut/Llama-3.2-3B-Instruct-rk3588-1.1.1

Text Generation • Updated Nov 6, 2024 • 16 • 1

c01zaut/Llama-3.2-1B-Instruct-rk3588-1.1.1

Text Generation • Updated Nov 6, 2024 • 3 • 1

jimmylam6666/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-Q8_0-GGUF

Text Generation • Updated Nov 15, 2024 • 20 • 1

matrixportal/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 1 • 1

matrixportal/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • Updated Nov 22, 2024 • 32 • 1

unsloth/Llama-3.2-11B-Vision-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 1.02k • 2

facebook/metamotivo-S-4

Updated Dec 12, 2024 • 16 • 2

facebook/metamotivo-M-1

Updated Dec 12, 2024 • 697 • 7

mlx-community/Llama-3.3-70B-Instruct-3bit

Text Generation • Updated Dec 6, 2024 • 1.56k • 6

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • Updated Dec 6, 2024 • 8.5k • 10

bartowski/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 28.9k • 49

lmstudio-community/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 6, 2024 • 72.4k • 44

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated 20 days ago • 236k • 29

unsloth/Llama-3.3-70B-Instruct-GGUF

Updated 20 days ago • 25.6k • 52

unsloth/Llama-3.3-70B-Instruct

Text Generation • Updated 20 days ago • 371k • 36

osllmai-community/Llama-3.3-70B-Instruct

Text Generation • Updated 3 days ago • 180 • 2

huihui-ai/Llama-3.3-70B-Instruct-abliterated

Text Generation • Updated Dec 12, 2024 • 1.38k • 20

cnfusion/Llama-3.3-70B-Instruct-abliterated-Q2-mlx

Text Generation • Updated Dec 19, 2024 • 43 • 1

mradermacher/Llama-3.3-70B-Instruct-abliterated-finetuned-i1-GGUF

Updated Dec 21, 2024 • 1.48k • 1

huihui-ai/Llama-3.3-70B-Instruct-abliterated-finetuned-GPTQ-Int4

Text Generation • Updated Dec 25, 2024 • 319 • 2

huihui-ai/Llama-3.3-70B-Instruct-abliterated-finetuned-GPTQ-Int8

Text Generation • Updated 21 days ago • 391k • 6

bartowski/Llama-3.3-70B-Instruct-abliterated-GGUF

Text Generation • Updated Dec 24, 2024 • 9.01k • 4

finnvoorhees/coreml-Llama-3.2-1B-Instruct-4bit

Text Generation • Updated 27 days ago • 24 • 2

c01zaut/Llama-3.1-8B-Instruct-rk3588-1.1.2

Text Generation • Updated Dec 27, 2024 • 5 • 1

c01zaut/Llama-3.2-3B-Instruct-rk3588-1.1.4

Text Generation • Updated 30 days ago • 10 • 1

finnvoorhees/coreml-Llama-3.2-3B-Instruct-4bit

Text Generation • Updated 30 days ago • 15 • 1

tensorblock/Llama-3.3-70B-Instruct-abliterated-GGUF

Updated 26 days ago • 410 • 1