Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,745

Full-text search

Active filters: awq

TechxGenus/stable-code-3b-AWQ

Text Generation • Updated Apr 7 • 24 • 1

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • Updated Jul 5 • 3.52k • 35

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16 • 523 • 12

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 10.4k • 68

TechxGenus/Meta-Llama-3-8B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.45k • 4

TechxGenus/Meta-Llama-3-70B-AWQ

Text Generation • Updated Apr 19 • 93 • 6

solidrust/Einstein-v6.1-Llama3-8B-AWQ

Text Generation • Updated Sep 3 • 33 • 4

HuggingFaceM4/idefics2-8b-chatty-AWQ

Image-Text-to-Text • Updated May 6 • 45 • 5

NexaAIDev/Octopus-v2-gguf-awq

Text Generation • Updated Jun 23 • 1.34k • 7

solidrust/Llama-3-Lumimaid-8B-v0.1-OAS-AWQ

Text Generation • Updated Sep 3 • 34 • 1

palisaderesearch/Badllama-3-8B

Text Generation • Updated Nov 20 • 1

dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-awq

Text Generation • Updated Jun 27 • 24 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13 • 1.58k • 37

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 413k • 61

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 167k • 92

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27 • 63.1k • 8

RiversHaveWings/Meta-Llama-3.1-405B-AWQ

Text Generation • Updated Jul 24 • 32 • 6

TechxGenus/Mistral-Large-Instruct-2407-AWQ

Text Generation • Updated Oct 11 • 1.11k • 10

casperhansen/mistral-large-instruct-2407-awq

Text Generation • Updated Jul 25 • 1.01k • 4

iwaitu/llama-3.1-70b-chinese-chat-AWQ-4bit

Text Generation • Updated Aug 28 • 25 • 5

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29 • 99 • 3

arcee-ai/deepseek-v2-chat-0628-awq

Updated Aug 17 • 763 • 6

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 238k • 42

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21 • 6.13k • 18

thesven/Phi-3.5-mini-instruct-awq

Updated Aug 29 • 255 • 1

VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct-awq

Updated Sep 1 • 135 • 1

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2 • 86 • 3

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated Oct 9 • 239 • 6

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 2.47k • 5

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 3.25k • 4