Very slow response on LM Studio with these settings
3
#4 opened 10 months ago
by
yassersharaf
Quantized Quality Bad?
1
#3 opened 12 months ago
by
thewise
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64212438290342c5df88a5fd/J-UD5oEmRwcBOzI9uJrLP.jpeg)
The Q4_0 file has "output.weight" quantized with Q6_K.
#2 opened over 1 year ago
by
mukel
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d784d0fd0b55d50184f485/4mdr0g8BzE1jOWYAGdtRC.jpeg)
Prompt Template
#1 opened over 1 year ago
by
tonymacx86PRO
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6307ff9a2d33960e6b77ca97/gvBc94B1xgNUoxJRR7kBe.jpeg)