Edit Models filters

Inference status

Misc

text-generation-inference

Inference Endpoints

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

179,181

Full-text search

Active filters: text-generation-inference

mlx-community/DeepSeek-V2.5-1210-3bit

Text Generation • Updated Dec 11, 2024 • 52 • 2

zelk12/MT-Gen3-BB-gemma-2-MT2g3MTg3-9B

Text Generation • Updated 22 days ago • 24 • 1

lianghsun/Llama-3.2-Taiwan-1B-Instruct

Text Generation • Updated 13 days ago • 8 • 2

SvalTek/Qwen2.5-ColdBrew

Text Generation • Updated about 1 month ago • 33 • 2

mlfoundations-dev/oh-dcft-v3.1-claude-3-5-haiku-20241022

Text Generation • Updated Dec 12, 2024 • 163 • 2

qingy2024/GRMR-2B-Instruct

Text Generation • Updated about 1 month ago • 73 • 15

mlfoundations-dev/oh-dcft-v3.1-llama-3.1-8b

Text Generation • Updated Dec 12, 2024 • 50 • 1

Sao10K/14B-Qwen2.5-Kunou-v1

Text Generation • Updated 28 days ago • 351 • 21

zelk12/MT-Merge3-GMA-gemma-2-9B

Text Generation • Updated 22 days ago • 24 • 1

zelk12/MT-Merge3-GMAMUI-gemma-2-9B

Text Generation • Updated 22 days ago • 28 • 1

qingy2024/GRMR-1.5B-Instruct

Text Generation • Updated Dec 11, 2024 • 17 • 1

parasail-ai/VLM2Vec-LLaVa-Next-vllm

Image-Text-to-Text • Updated Dec 11, 2024 • 52 • 1

rudrankriyam/Hermes-3-Llama-3.2-3B-4bit

Text Generation • Updated Dec 11, 2024 • 27 • 1

qingy2024/GRMR-3B-Instruct

Text Generation • Updated Dec 11, 2024 • 21 • 1

kenhktsui/llama3.1-8b-instruct-thinking-sft-merged-gguf

Updated 13 days ago • 28 • 1

mradermacher/Omnia-2x7B-i1-GGUF

Updated about 1 month ago • 81 • 1

lightblue/reranker_0.5_bin_filt

Text Generation • Updated Dec 12, 2024 • 25 • 1

ikedachin/llm-jp-3-13b-october-news-e1-all-3-5

Updated 27 days ago • 1

themex1380/Gemma-2-9B-Uncensored

Text Generation • Updated Dec 12, 2024 • 81 • 2

prithivMLmods/QwQ-LCoT-3B-Instruct

Text Generation • Updated 29 days ago • 300 • 9

prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF

Text Generation • Updated 30 days ago • 1.29k • 10

suayptalha/VexGPT

Text Generation • Updated Dec 12, 2024 • 20 • 1

QuantFactory/FastLlama-3.2-1B-Instruct-GGUF

Updated about 1 month ago • 311 • 1

DavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B

Text Generation • Updated about 1 month ago • 132 • 1

djuna/G2-Nowing-9B

Text Generation • Updated about 1 month ago • 24 • 1

djuna/G2-Nowing-9B-32K-YS

Text Generation • Updated about 1 month ago • 26 • 1

SvalTek/L3-ColdBrew-ReflectRedux

Text Generation • Updated about 1 month ago • 20 • 1

marinarosell/Meta-Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • Updated about 1 month ago • 50 • 1

saidsef/flan-t5-small-tuned-tech-docs

Text2Text Generation • Updated 25 days ago • 57 • 1

Vamsi002/albanian-gpt2

Text Generation • Updated 29 days ago • 21 • 1