Higgs-Llama-3-70B

ExLlamav2 4 bpw 8 hb quants of https://huggingface.co/bosonai/Higgs-Llama-3-70B

Downloads last month
4
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.

Model tree for altomek/Higgs-Llama-3-70B-4bpw-EXL2

Quantized
(5)
this model