Hugging Face's logo

latimar
/
Synthia-13B-exl2

Text Generation
Transformers
llama
Inference Endpoints
Model card Files Community
1

Can you quantize MythoMax

#1
by TheYuriLover - opened
Discussion
TheYuriLover

This one deserves a 4.625 and 5.0 bpw quant :D

latimar
 Owner

There are already EXL2 quants of MythoMax: https://huggingface.co/QMB15/mythomax-13B-8.13bit-MAX-exl2 , https://huggingface.co/QMB15/mythomax-L2-13B-4.625bit-exl2

Sign up or log in to comment