Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

4,170

Full-text search

Active filters: exl2

FuturisticVibes/Tiger-Gemma-9B-v3-8.0bpw-h8-exl2

Updated Oct 5 • 18 • 2

gghfez/zetasepic_Qwen2.5-72B-Instruct-abliterated-exl2-4.5bpw

Text Generation • Updated Oct 7 • 18 • 3

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-6.5bpw-exl2

Text Generation • Updated Oct 12 • 21 • 1

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-8.0bpw-8hb-exl2

Text Generation • Updated Oct 16 • 30 • 3

Jellon/Qwen2.5-72B-Instruct-abliterated-exl2-3bpw

Text Generation • Updated Oct 23 • 22 • 1

DBMe/magnum-v4-72b-4.47bpw-h6-exl2

Text Generation • Updated Oct 24 • 28 • 1

Jellon/Pantheon-RP-Pure-1.6.2-22b-Small-exl2-6bpw

Updated Oct 25 • 32 • 1

MikeRoz/TheDrummer_Nautilus-70B-v0.1-5.0bpw-h6-exl2

Updated Oct 26 • 7 • 1

waldie/Cydonia-22B-v1.2-6.5bpw-h6-exl2

Updated Oct 26 • 23 • 1

denru/Behemoth-123B-v1.1-5_0bpw-h6-exl2-pippa

Updated Oct 27 • 16 • 2

MikeRoz/TheDrummer_Behemoth-123B-v1.1-6.0bpw-h6-exl2

Updated Oct 27 • 38 • 2

MikeRoz/TheDrummer_Behemoth-123B-v1.1-5.0bpw-h6-exl2

Updated Oct 27 • 33 • 4

MikeRoz/TheDrummer_Behemoth-123B-v1.1-4.0bpw-h6-exl2

Updated Oct 27 • 33 • 1

MikeRoz/TheDrummer_Behemoth-123B-v1.1-2.5bpw-h6-exl2

Updated Oct 28 • 12 • 1

waldie/Cydonia-v1.2-Magnum-v4-22B-6.5bpw-h6-exl2

Text Generation • Updated Oct 28 • 24 • 1

waldie/UnslopSmall-22B-v1-4.65bpw-h6-exl2

Updated Oct 30 • 6 • 1

Statuo/Starcannon-Unleashed-12b-EXL2-4bpw

Text Generation • Updated Oct 31 • 46 • 1

async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.75bpw

Text Generation • Updated Nov 2 • 21 • 1

async0x42/EVA-Qwen2.5-32B-v0.2-exl2_5.0bpw

Text Generation • Updated Nov 6 • 38 • 1

WaveCut/IlyaGusev-saiga_nemo_12b_sft_m9_d16_simpo_m21_d36-EXL2-8bpw

Updated Nov 7 • 6 • 1

DeusImperator/EVA-Qwen2.5-32B-v0.2_exl2_4.6bpw

Text Generation • Updated Nov 20 • 28 • 1

waldie/EVA-Qwen2.5-32B-v0.2-4bpw-h6-exl2

Text Generation • Updated Nov 8 • 144 • 2

MikeRoz/TheDrummer_Behemoth-123B-v1.1-4.25bpw-h6-exl2

Updated Nov 8 • 20 • 2

waldie/TQ2.5-14B-Sugarquill-v1-8bpw-h8-exl2

Text Generation • Updated Nov 9 • 23 • 1

cgus/Qwen2.5-14B-Instruct-abliterated-v2-exl2

Text Generation • Updated Nov 12 • 27 • 2

openerotica/Mistral-Small-Instruct-2409-abliterated-4.5bpw-exl2

Text Generation • Updated Nov 11 • 64 • 1

DrNicefellow/Qwen2.5-Coder-32B-Instruct-4.0bpw-exl2

Updated Nov 12 • 16 • 1

DrNicefellow/Qwen2.5-Coder-32B-Instruct-3.0bpw-exl2

Updated Nov 12 • 19 • 1

async0x42/Qwen2.5-Coder-0.5B-Instruct-exl2_5.0bpw

Text Generation • Updated Nov 12 • 23 • 1

async0x42/Athene-V2-Chat-exl2_3.5bpw

Text Generation • Updated Nov 15 • 36 • 1