notstoic commited on
Commit
aa07aa2
1 Parent(s): b323437

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -1,6 +1,7 @@
1
  4-bit GPTQ quantization of https://huggingface.co/KoboldAI/OPT-13B-Erebus
 
2
 
3
  python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save models/KoboldAI_OPT-13B-Erebus/OPT-13B-Erebus-4bit-128g.pt
 
4
  python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save_safetensors models/KoboldAI_OPT-13B-Erebus/OPT-13B-Erebus-4bit-128g.safetensors
5
 
6
- Using this fork of GPTQ: https://github.com/0cc4m/GPTQ-for-LLaMa
 
1
  4-bit GPTQ quantization of https://huggingface.co/KoboldAI/OPT-13B-Erebus
2
+ Using this fork of GPTQ: https://github.com/0cc4m/GPTQ-for-LLaMa
3
 
4
  python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save models/KoboldAI_OPT-13B-Erebus/OPT-13B-Erebus-4bit-128g.pt
5
+
6
  python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save_safetensors models/KoboldAI_OPT-13B-Erebus/OPT-13B-Erebus-4bit-128g.safetensors
7