The refusal rate is very high, it kind of look like the original censored model
#1
by
sneedingface
- opened
Did you notice that yourself as well?
It is not that bad, but it should be better.
It is not that bad, but it should be better.
It is, it even refuses to print the system prompt that you gave to it firsthand which is ridiculous, this is just an example to show the extent of the issue. It's unusable in its current state, which is a shame since it's the first ok-ish model that can run locally on smartphone at a reasonable speed
That is surprising, even Gemma 2 is not terrible for refusals
That is surprising, even Gemma 2 is not terrible for refusals
I was wondering if you have the time to give it a try and double check this issue, if that's not a problem and you feel like to of course. In any case thanks for your work, much appreciated