Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

8-bit precision

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

238

Full-text search

Active filters: int8

Anthonyg5005/L3-8B-Stheno-v3.1-int8-ct2

Text Generation • Updated Jun 17 • 12

Anthonyg5005/turbcat-instruct-8b-int8-ct2

Text Generation • Updated Jun 20 • 11

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • Updated 17 days ago • 5.5k • 8

angeloc1/llama3dot1SimilarProcesses8

Text Generation • Updated Jul 27 • 4

angeloc1/llama3dot1DifferentProcesses8

Text Generation • Updated Jul 27 • 6

FriendliAI/Meta-Llama-3-8B-int8

Text Generation • Updated Aug 1 • 22 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a16

Text Generation • Updated Oct 9 • 343 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated 18 days ago • 559 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 3.01k • 1

neuralmagic/gemma-2-2b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 71 • 1

neuralmagic/gemma-2-2b-quantized.w8a16

Text Generation • Updated Oct 9 • 62

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 58

neuralmagic/gemma-2-2b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 464

angeloc1/llama3dot1FoodDel8v02

Text Generation • Updated Aug 18 • 7

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 492 • 2

neuralmagic/SmolLM-360M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 19

neuralmagic/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 595

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 27

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation • Updated Sep 7 • 7

FriendliAI/Meta-Llama-3.1-8B-Instruct-int8

Text Generation • Updated Sep 9 • 15 • 1

FriendliAI/Meta-Llama-3.1-70B-Instruct-int8

Text Generation • Updated Sep 9 • 43

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated about 1 month ago • 39

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated 27 days ago • 45

minpeter/Qwen-Qwen2-1.5B-Instruct-fmo-int8

Updated 2 days ago • 2

minpeter/mistralai-Mistral-Nemo-Instruct-2407-fmo-int8

Updated 1 day ago • 2

minpeter/Qwen-Qwen2.5-14B-Instruct-fmo-int8

Updated 1 day ago • 2

minpeter/Qwen-Qwen2.5-32B-Instruct-fmo-int8

Updated 1 day ago

minpeter/anthracite-org-magnum-v4-72b-fmo-int8

Updated 1 day ago • 8