Hugging Face's logo

rAIfle
/
Cat-Llama-3-70B-instruct-exl2

Model card Files Community
Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

EXL2 quants of Cat Llama-3 70B instruct

Other EXL2 quants: Cat Llama-3 70B instruct exl2

2.25 bits per weight
4.65 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .