Arconte-13B

GUFF quants from ThenMagician/Arconte-13B.

I uploaded all of the guffs some time ago but I let the repo on private, my bad.

Imatrix quants were done from the f16 guff with a small subset of RP data I have, around 17 chunks, it achieved a perplexity of approximately 3.4 if I remember correctly.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.