Edit Models filters

Inference status

Misc

compressed-tensors

AutoTrain Compatible

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

270

Full-text search

Active filters: compressed-tensors

neuralmagic/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2 • 49.3k • 11

neuralmagic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic

Text Generation • Updated 27 days ago • 11.7k • 10

neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated Oct 9 • 115k • 33

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated 25 days ago • 1.85k • 4

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Oct 9 • 51k • 32

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Oct 9 • 1.72k • 31

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic

Text Generation • Updated 25 days ago • 362 • 14

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • Updated 20 days ago • 5.28k • 9

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated 20 days ago • 9.04k • 11

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 1.38k • 3

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 11.5k • 11

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10 • 2.94k • 12

neuralmagic/gemma-2-9b-it-quantized.w4a16

Text Generation • Updated Oct 9 • 419 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 199 • 2

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 855 • 2

nm-testing/Phi-3.5-MoE-instruct-FP8

Updated Oct 9 • 68 • 2

neuralmagic/Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9 • 1.32k • 2

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9 • 1.84k • 2

neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • Updated 27 days ago • 1.79k • 3

neuralmagic/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2 • 13.8k • 3

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated 27 days ago • 8.93k • 2

neuralmagic/Phi-3.5-mini-instruct-FP8-KV

Text Generation • Updated Oct 1 • 305 • 1

qeternity/Qwen2.5-72B-Instruct-W8A8

Updated Oct 1 • 9 • 1

nm-testing/NVLM-D-72B-FP8-dynamic

Updated Oct 7 • 1.44k • 2

neuralmagic/pixtral-12b-FP8-dynamic

Text Generation • Updated 11 days ago • 3.12k • 1

noneUsername/SuperNova-Medius-W8A8-Dynamic-Per-Token

Updated 25 days ago • 468 • 1

flowaicom/Flow-Judge-v0.1-FP8

Updated 29 days ago • 56 • 1

flowaicom/Flow-Judge-v0.1-W8A16

Updated 29 days ago • 21 • 1

flowaicom/Flow-Judge-v0.1-W4A16

Updated 29 days ago • 37 • 1

thwin27/Aria-sequential_mlp-FP8-dynamic

Image-Text-to-Text • Updated 20 days ago • 204 • 5