Resources

CUDA extension not installed (even after manual compile and pip install)

#26 opened 4 months ago by

markemicek

GGUF format

#25 opened 11 months ago by

giladgd

TypeError: 'NoneType' object is not iterable in .../models_settings.py

#24 opened about 1 year ago by

thinktink

Calibration dataset used to perform GPTQ

#23 opened about 1 year ago by

ht-rohit

A weird bug

#22 opened about 1 year ago by

XceptDev

Offloading to cpu not working?

#21 opened about 1 year ago by

fahadh4ilyas

May I ask why the GPTQ version is slow

#20 opened about 1 year ago by

lynngao815

can you upload a falcon-40b-GPTQ?

#18 opened about 1 year ago by

Gian-hf

Update README.md

#17 opened about 1 year ago by

saattrupdan

OOM when running the simple code again in jupyter notebook

#16 opened over 1 year ago by

becks2000

Issues with Auto

#15 opened over 1 year ago by

Devonance

What is the different between GPTQ and QLoRA?

#12 opened over 1 year ago by

Ichsan2895

error when loading sucessful and prompting simple text

#11 opened over 1 year ago by

joseph3553

Custom 4-bit Finetuning 5-7 times faster inference than QLora

#7 opened over 1 year ago by

rmihaylov

Error when attempting to run.. Appears model files are missing or configuration issue

#6 opened over 1 year ago by

jdc4429

cuda extension not installed

#5 opened over 1 year ago by

becks2000

3bit quantization

#3 opened over 1 year ago by deleted

GGML?

#2 opened over 1 year ago by

creative420

Unfortunately I can't run on text-generation-webui

#1 opened over 1 year ago by

Suoriks