GGUFs available?

#1
by sdstealth - opened

Are there any GGUF files available for this model yet? Trying to add in LM studio and it's not finding anything. The 1.2 is good but can't wait to try this one.

Arli AI org

Oh didn't realized it failed to upload.

Oh didn't realized it failed to upload.

Oh nice okay-- do you mind uploading again? Super eager to try this!

Arli AI org

I've managed to upload Q4 and Q5 quants for now. But Bartowski is working on his quants for this model.

Sign up or log in to comment