hamel commited on
Commit
65d0556
1 Parent(s): 20090db

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1,6 +1,6 @@
1
  4bit AWQ Quantized Version of [parlance-labs/hc-mistral-alpaca-merged](https://huggingface.co/parlance-labs/hc-mistral-alpaca-merged)
2
 
3
- I used AutoAWQ
4
 
5
  ```python
6
  from awq import AutoAWQForCausalLM
 
1
  4bit AWQ Quantized Version of [parlance-labs/hc-mistral-alpaca-merged](https://huggingface.co/parlance-labs/hc-mistral-alpaca-merged)
2
 
3
+ This is how to use [AutoAWQ](https://github.com/casper-hansen/AutoAWQ/tree/main) to quantize the model.
4
 
5
  ```python
6
  from awq import AutoAWQForCausalLM