Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

4,170

Full-text search

Active filters: exl2

wolfram/Athene-V2-Chat-4.65bpw-h6-exl2

Text Generation • Updated Nov 15 • 107 • 5

async0x42/Rombos-Coder-V2.5-Qwen-32b-exl2_4.0bpw

Text Generation • Updated Nov 16 • 21 • 1

Jellon/Athene-V2-Chat-72b-exl2-3bpw

Text Generation • Updated Nov 16 • 32 • 2

bullerwins/Athene-V2-Chat-exl2_8.0bpw

Text Generation • Updated Nov 17 • 27 • 1

waldie/Beepo-22B-5.5bpw-h6-exl2

Updated Nov 17 • 25 • 1

async0x42/Qwen2.5-Gutenberg-Doppel-32B-exl2_5.0bpw

Text Generation • Updated Nov 18 • 19 • 1

MikeRoz/mistralai_Mistral-Large-Instruct-2411-3.0bpw-h6-exl2

Updated Nov 19 • 14 • 1

MikeRoz/mistralai_Mistral-Large-Instruct-2411-2.5bpw-h6-exl2

Updated Nov 19 • 20 • 2

MikeRoz/mistralai_Mistral-Large-Instruct-2411-5.0bpw-h6-exl2

Updated Nov 19 • 19 • 1

Jellon/MS-Meadowlark-22B-exl2-4bpw

Text Generation • Updated Nov 19 • 25 • 1

wolfram/Mistral-Large-Instruct-2411-2.75bpw-h6-exl2

Updated Nov 20 • 16 • 2

waldie/Cydonia-v1.3-Magnum-v4-22B-5.5bpw-h6-exl2

Text Generation • Updated Nov 22 • 99 • 1

dakkidaze/Cydonia-22B-v1.3-4.5bpw-h6-exl2

Updated about 1 month ago • 59 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_5.0bpw_h6

Updated 30 days ago • 127 • 2

MikeRoz/TheDrummer_Behemoth-123B-v2.1-5.0bpw-h6-exl2

Updated 29 days ago • 525 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_6.0bpw_h6

Updated 29 days ago • 45 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_8.0bpw_h8

Updated 29 days ago • 96 • 1

Darkhn/Behemoth-123B-v2.1-3.5bpw-h6-exl2

Updated 28 days ago • 21 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v2.1_exl2_8.0bpw_h8

Updated 27 days ago • 62 • 1

DrNicefellow/Qwen-QwQ-32B-Preview-8.0bpw-h8-exl2

Updated 27 days ago • 69 • 2

imnotednamode/OuteTTS-0.2-500M-exl2-b6.0-hb8

Text-to-Speech • Updated 27 days ago • 34 • 1

DrNicefellow/Qwen-QwQ-32B-Preview-4.25bpw-exl2

Text Generation • Updated 26 days ago • 50 • 3

async0x42/QwQ-32B-Preview-exl2_4.5bpw

Text Generation • Updated 25 days ago • 52 • 1

DBMe/EVA-Qwen2.5-72B-v0.2-4.86bpw-h6-exl2

Text Generation • Updated 24 days ago • 36 • 1

FluffyKaeloky/Cakrawala-123B-exl2-4.0bpw

Text Generation • Updated 25 days ago • 45 • 1

FluffyKaeloky/Cakrawala-123B-exl2-3.5bpw

Text Generation • Updated 25 days ago • 34 • 1

DBMe/EVA-Qwen2.5-72B-v0.2-4.48bpw-h6-exl2

Text Generation • Updated 24 days ago • 43 • 1

Dracones/Qwen2.5-Coder-32B-Instruct_exl2_4.0bpw

Text Generation • Updated 23 days ago • 23 • 2

James2313123/L3.1-RP-Hero-Dirty_Harry-8B_2.65bpw-h6-exl2

Updated 23 days ago • 22 • 1

Dracones/Athene-V2-Chat_exl2_4.5bpw

Text Generation • Updated 10 days ago • 25 • 1