GPTQ 2-bit no actor version for compatibility that works in textgen-webui | |
Generated by using scripts from https://gitee.com/yhyu13/llama_-tools | |
Merged weights: https://huggingface.co/Yhyu13/oasst-rlhf-2-llama-30b-7k-steps-hf | |
Converted LLaMA weights: https://huggingface.co/Yhyu13/llama-30B-hf-openassitant | |
Delta weights: https://huggingface.co/OpenAssistant/oasst-rlhf-2-llama-30b-7k-steps-xor |