GPTQ 4-bit no actor version for compatibility that works in textgen-webui

Generated by using scripts from https://gitee.com/yhyu13/llama_-tools

Original weight : https://huggingface.co/VMware/open-llama-7b-open-instruct

Downloads last month
17
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.