Broken model!
#1
by
wolfram
- opened
airoboros-l2-70b-3.1.2.Q4_0.gguf
is outputting nonsense:
brie◄ cabigliateckgenommenÝbriebriebriebriebriebriebriebriebriebriebriebriebr...
Looks like that old problem I reported a while ago: TheBloke/Spicyboros-70B-2.2-GGUF # 1 spicyboros-70b-2.2.Q4_0.gguf broken as well?
Cant make model work, only gibberish in the output
"brieiomgreswehrrobloyeehung Feder prolong"
Using llama.cpp cpu only