greatest local model I've seen so far
Yeah, it's greatest local model I've seen so far. Seems far more smart than anything else local I've tried before. Seems for me pretty close to Claude and GPT4, infinitely better than 3.5 turbo, for example. Thanks to great people hosting it on KoboldHorde!
Btw, so far for me model seems to do best with temp 0.5, Top P=1, Top K=Top A=0, rep penalty =1 and mirostat stats off.
Really glad to hear that this model is performing well. I use it as well for day to day work.
It's definitely not on par with GPT-4 for all use cases, but I agree this model is very good. It probably matches Claude, but Claude is very good in safety alignment, which I haven't focused on with Synthia models.
This is the first time I'm hearing about Kobold Horde! Very interesting -- I'm glad they're hosting Synthia.
I have a new model coming out in the next few days, Synthia-13B-v1.2. I'm hoping this would provide the coverage needed for lower sized models, as the 34B model is not that great. The 34B is based on CodeLLaMA, and because of that it's not great for general purpose use.
Nice! Thank you for your great work!
As for "safety alignment", that is surely something ppl like me do not appreciate about LLM, ppl who use LLM to roleplay stuff. :p
Synthia-13B-v1.2 is out.. Enjoy!