PsyMedRP 20B Ultra High Quality Version Possible?

#1
by Elfrino - opened

Hi David,

I wanted to thankyou for the post you made in froggerics space on Creativity and Quants. You're absolutely correct, slightly lower quants (Q5, Q6) seem to have far more creativity then the high Q8 quants. I've noticed this across many models now and it also is great as it saves on my dwindling HD space! haha. So thankyou for this gem of information, worth it's weight in gold.

I was wondering if you have ever tried the PsyMedRP 20B model from Undi?: https://huggingface.co/Undi95/PsyMedRP-v1-20B-GGUF

It's actually my favorite model for creative endeavors as it has very creative, expressive and interesting writing style and if you tweak the settings just right it can really give you fantastic output (aka Heavy Metal Comic outlandish and bizarre concepts, scenes and worlds) . I highly recommend checking it out if you haven't yet. I've downloaded most of the quants but the q5_k_m and q6_k are the sweet spot of creativity for this model (especially q5_k_m).

Saying all that I would love to try a Ultra High Quality version of this model, just to see if it would enhance it's creativity if the model quality is boosted to such a
high definition extent. Possibly ultra high quality version somehow push through the q8_0 flat zone?

Any chance if you could possibly make a Ultra High Quality version of it?

Thanks again! :)

Owner

Thanks so much!

RE: PsyMed ; I have tried it , and it rated highly in my list.
Based on the information at the site, it could be reproduced in whole - greatest increase in quality.
However - there is some guess work here, as it uses an older method/version of "mergekit" so to speak.

At a min (from current source) an upscale 32, + imatrix + "plus" would also improve it - specifically the GGUFs.
The change it not as strong as a full "rebuild" but it does show.

Added to the list.
D

Fantastic, thankyou! Will be looking forward to it when you release it. :)

Sign up or log in to comment