Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

18

Full-text search

Active filters: higgs

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-GPTQ-4bit

Updated Dec 12, 2024 • 23 • 2

ISTA-DASLab/gemma-2-9b-it-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 77

ISTA-DASLab/gemma-2-9b-it-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 80

ISTA-DASLab/gemma-2-9b-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 76

ISTA-DASLab/gemma-2-9b-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 76

ISTA-DASLab/Llama-3.1-8B-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 78

ISTA-DASLab/Llama-3.1-8B-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 77

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 79

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 79

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 10

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 3

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-4bit

Text Generation • Updated Dec 9, 2024 • 16 • 3

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 7

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-4bit

Text Generation • Updated Dec 10, 2024 • 80

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-3bit

Text Generation • Updated Dec 10, 2024 • 13

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-3bit

Text Generation • Updated Dec 10, 2024 • 78

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-4bit

Text Generation • Updated Dec 10, 2024 • 81

PrunaAI/meta-llama-Llama-3.1-8B-Instruct-Higgs-2bit-smashed

Updated Dec 20, 2024 • 3