| language: en | |
| license: other | |
| commercial: no | |
| inference: false | |
| # pygmalion-13b-4bit-128g | |
| ## Model description | |
| **Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.** | |
| Quantized from the decoded pygmalion-13b xor format. | |
| **https://huggingface.co/PygmalionAI/pygmalion-13b** | |
| In safetensor format. | |
| ### Quantization Information | |
| GPTQ CUDA quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa | |
| ``` | |
| python llama.py --wbits 4 models/pygmalion-13b c4 --true-sequential --groupsize 128 --save_safetensors models/pygmalion-13b/4bit-128g.safetensors | |
| ``` |