Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,906

Full-text search

Active filters: awq

OliP/Phi-3-mini-128k-instruct-awq

Text Generation • Updated Jul 9, 2024 • 3 • 2

typealias/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 3, 2024 • 5

zhiG/Llama-3-Swallow-70B-Instruct-v0.1-awq-4bit

Text Generation • Updated Jul 3, 2024 • 7

PrunaAI/Sao10K-L3-8B-Chara-v1-Alpha-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 3

PrunaAI/eryk-mazus-polka-1.1b-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 3

bsmit1659/Phi-3-mini-128k-instruct-0.2-awq

Text Generation • Updated Jul 3, 2024 • 5

PrunaAI/mistralai-Mistral-7B-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 9

rubra-ai/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Jul 4, 2024 • 4

ravi-wcg/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 4, 2024 • 3

ravi-wcg/Llama-3-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 4, 2024 • 3

Weni/ZeroShot-Agents-Llama3-4.0.47-SFT-AWQ

Text Generation • Updated Jul 4, 2024 • 4

Weni/ZeroShot-Agents-Llama3-4.0.48-SFT-AWQ

Text Generation • Updated Jul 5, 2024 • 2

Weni/ZeroShot-Agents-Llama3-4.0.49-DPO-AWQ

Text Generation • Updated Jul 5, 2024 • 4

ellamind/qwen2-72b-instruct-awq-de

Text Generation • Updated Jul 22, 2024 • 3

emaibb/magnum-72b-v1-awq

Text Generation • Updated Jul 5, 2024 • 2 • 3

Weni/ZeroShot-Agents-Llama3-4.0.50-SFT-AWQ

Text Generation • Updated Jul 5, 2024 • 5

elysiantech/gemma-2b-awq-4bit

Text Generation • Updated Jul 5, 2024 • 3

elysiantech/phi-3-mini-4k-instruct-awq-4bit

Text Generation • Updated Jul 6, 2024 • 4

Weni/ZeroShot-Agents-Llama3-4.0.52-SFT-AWQ

Text Generation • Updated Jul 6, 2024 • 6

Weni/ZeroShot-Agents-Llama3-4.0.53-SFT-AWQ

Text Generation • Updated Jul 6, 2024 • 5

Weni/ZeroShot-Agents-Llama3-4.0.54-SFT-AWQ

Text Generation • Updated Jul 6, 2024 • 3

Weni/ZeroShot-Agents-Llama3-4.0.55-SFT-AWQ

Text Generation • Updated Jul 7, 2024 • 5

pankajmathur/orca_mini_v7_7b-AWQ

Text Generation • Updated Dec 29, 2024 • 74 • 1

pankajmathur/orca_mini_v6_8b-AWQ

Text2Text Generation • Updated Dec 29, 2024 • 57 • 1

pankajmathur/orca_mini_v6_8b_dpo-AWQ

Text2Text Generation • Updated Dec 29, 2024 • 54 • 1

Weni/ZeroShot-Agents-Llama3-4.0.56-SFT-AWQ

Text Generation • Updated Jul 7, 2024 • 4

Weni/ZeroShot-Agents-Llama3-4.0.57-SFT-AWQ

Text Generation • Updated Jul 7, 2024 • 3

solidrust/dolphin-2.9.3-mistral-7B-32k-AWQ

Text Generation • Updated Sep 3, 2024 • 76

shunran/L3-ChaoticSoliloquy-v1.5-4x8B-awq

Text Generation • Updated Jul 8, 2024 • 2

nihaomur/Llama-3-Taiwan-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 19, 2024 • 79 • 1