Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Inference Endpoints

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,805

Full-text search

Active filters: 6-bit

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 82 • 1

Statuo/MiS-Firefly-v0.2-22b-EXL2-6bpw

Text Generation • Updated Nov 9, 2024 • 9

MaziyarPanahi/calme-3.3-llamaloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 71

MarsupialAI/Stellar-Odyssey-12b-adventure-v0.0_EXL2_6bpw_H8

Text Generation • Updated Nov 11, 2024 • 3

DrNicefellow/Qwen2.5-Coder-32B-Instruct-6.0bpw-exl2

Updated Nov 12, 2024 • 2

bullerwins/Qwen2.5-Coder-32B-exl2_6.0bpw

Text Generation • Updated Nov 12, 2024 • 6

Jellon/MSM-MS-Cydrion-22B-exl2-6bpw

Text Generation • Updated Nov 12, 2024 • 4

DrNicefellow/Qwen2.5-Coder-14B-Instruct-6.0bpw-exl2

Updated Nov 12, 2024 • 4

MarsupialAI/UnslopNemo-12B-v3_EXL2_6bpw_H8

Updated Nov 13, 2024 • 4 • 1

DrNicefellow/Qwen2.5-7B-O1-Journey-1-6.0bpw-exl2

Updated Nov 17, 2024 • 2

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated Nov 15, 2024 • 74 • 7

bullerwins/Athene-V2-Chat-exl2_6.0bpw

Text Generation • Updated Nov 17, 2024 • 6

MikeRoz/sophosympatheia_Evathene-v1.0-6.0bpw-h6-exl2

Text Generation • Updated Nov 17, 2024 • 10 • 1

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated Nov 20, 2024 • 1.02M • 1

schnapper79/mistralai_large_instruct_2411-exl2-6.0bpw

Text Generation • Updated Nov 20, 2024 • 4

Jellon/MS-Meadowlark-22B-exl2-h8-6bpw

Text Generation • Updated Nov 19, 2024 • 9

MikeRoz/mistralai_Mistral-Large-Instruct-2411-6.0bpw-h6-exl2

Updated Nov 20, 2024 • 2

BigHuggyD/Mistral-Large-Instruct-2411_exl2_6.0bpw_h6

Updated Nov 20, 2024 • 6

bullerwins/Mistral-Large-Instruct-2411-exl2_6.0bpw

Updated Nov 20, 2024 • 3

Statuo/MS-Cydonia-v1.3-EXL2-6bpw

Updated Nov 22, 2024 • 8

MikeRoz/ArliAI_Llama-3.1-70B-ArliAI-RPMax-v1.3-6.0bpw-h6-exl2

Updated Nov 22, 2024 • 1

BigHuggyD/MarsupialAI_Monstral-123B_exl2_6.0bpw_h6

Text Generation • Updated Nov 23, 2024 • 19

mlx-community/Qwen2.5-Coder-32B-Instruct-6bit

Text Generation • Updated Nov 23, 2024 • 91 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_6.0bpw_h6

Updated Nov 25, 2024 • 5 • 1

mlx-community/Llama-3.1-Tulu-3-70B-6bit

Text Generation • Updated Nov 25, 2024 • 11

BigHuggyD/TheDrummer_Behemoth-123B-v2.1_exl2_6.0bpw_h6

Updated Nov 27, 2024 • 3

mlx-community/OLMo-2-1124-7B-Instruct-6bit

Text Generation • Updated Nov 27, 2024 • 51

mlx-community/QwQ-32B-Preview-6bit

Text Generation • Updated Nov 27, 2024 • 129 • 4

mlx-community/OLMo-2-1124-13B-Instruct-6bit

Text Generation • Updated Nov 27, 2024 • 9

DrNicefellow/Qwen-QwQ-32B-Preview-6.0bpw-exl2

Updated Nov 28, 2024 • 3