Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,988

Full-text search

Active filters: 6-bit

BigHuggyD/c4ai-command-r-plus-08-2024_exl2_6.0bpw_h6

Text Generation • Updated Aug 31, 2024 • 6

Statuo/Stardust-12b-MN-EXL2-6bpw

Text Generation • Updated Sep 1, 2024 • 3

gghfez/ArliAI-RPMax-12B-v1.1-exl2-6.0bpw

Updated Sep 1, 2024 • 5 • 1

bullerwins/c4ai-command-r-plus-08-2024-exl2_6.0bpw

Text Generation • Updated Sep 2, 2024 • 5

FuturisticVibes/Star-Command-R-32B-v1-6.0bpw-h8-exl2

Updated Sep 2, 2024 • 4

kyynaama/Mistral-Nemo-Instruct-2407-abliterated-exl2-6bpw

Updated Sep 3, 2024 • 8

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_6.0bpw_h6

Text Generation • Updated Sep 7, 2024 • 6

bigstorm/Mistral-Large-Instruct-2407-6.0bpw-8hb-exl2

Updated Sep 4, 2024 • 6

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 776k • 2

LoneStriker/Yi-Coder-9B-Chat-6.0bpw-h6-exl2

Text Generation • Updated Sep 4, 2024 • 4

LoneStriker/Yi-Coder-9B-6.0bpw-h6-exl2

Updated Sep 4, 2024 • 5

Statuo/Stardust-V2-EXL2-6bpw

Text Generation • Updated Sep 5, 2024 • 6

bullerwins/Reflection-70B-exl2_6.0bpw

Text Generation • Updated Sep 6, 2024 • 2 • 1

LoneStriker/Reflection-Llama-3.1-70B-6.0bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 6 • 1

bigstorm/Reflections-Llama-3.1-70B-6.0bpw-8hb-exl2

Text Generation • Updated Sep 6, 2024 • 4 • 1

FuturisticVibes/c4ai-command-r-plus-08-2024-6.0bpw-h8-exl2

Text Generation • Updated Sep 7, 2024 • 4

Statuo/Lyra-V4-EXL2-6bpw

Updated Sep 8, 2024 • 4

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated Sep 11, 2024 • 77.4k • 4

MikeRoz/mattshumer_ref_70_e3-6.0bpw-h6-exl2

Text Generation • Updated Sep 9, 2024 • 6

MaziyarPanahi/ref_70_e3-GGUF

Text Generation • Updated Sep 10, 2024 • 22

MikeRoz/TheDrummer_Theia-21B-v2-6.0bpw-h6-exl2

Updated Sep 9, 2024 • 12

Statuo/MN-12b-ArliAI-RPMax-EXL2-6bpw

Updated Sep 10, 2024 • 6

drexample/Llama-Guard-3-8B-exl2-bpw6

Updated Sep 10, 2024 • 6

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-6.0bpw

Updated Sep 11, 2024 • 4 • 1

MaziyarPanahi/reader-lm-0.5b-GGUF

Text Generation • Updated Sep 11, 2024 • 16 • 2

MaziyarPanahi/reader-lm-1.5b-GGUF

Text Generation • Updated Sep 11, 2024 • 78 • 1

bigstorm/dolphin-2.9.4-llama3.1-8b-6.0bpw-6hb-exl2

Updated Sep 14, 2024 • 3

bigstorm/dolphin-2.9.4-llama3.1-8b-6.0bpw-8hb-exl2

Updated Sep 14, 2024 • 2

MikeRoz/TheDrummer_Donnager-70B-v1-6.0bpw-h6-exl2

Updated Sep 15, 2024 • 4

bigstorm/dolphin-2.9.3-mistral-nemo-12b-6.0bpw-6hb-exl2

Updated Sep 15, 2024 • 5