Abhinav Kulkarni
commited on
Commit
•
e07785d
1
Parent(s):
ea43866
Updated README
Browse files
README.md
CHANGED
|
@@ -19,7 +19,7 @@ July 29, 2023
|
|
| 19 |
|
| 20 |
## Model License
|
| 21 |
|
| 22 |
-
Please refer to original
|
| 23 |
|
| 24 |
Please refer to the AWQ quantization license ([link](https://github.com/llm-awq/blob/main/LICENSE)).
|
| 25 |
|
|
@@ -41,6 +41,7 @@ git clone https://github.com/mit-han-lab/llm-awq \
|
|
| 41 |
```
|
| 42 |
|
| 43 |
```python
|
|
|
|
| 44 |
import torch
|
| 45 |
from awq.quantize.quantizer import real_quantize_model_weight
|
| 46 |
from transformers import AutoModelForCausalLM, AutoConfig, AutoTokenizer, TextStreamer
|
|
|
|
| 19 |
|
| 20 |
## Model License
|
| 21 |
|
| 22 |
+
Please refer to original StableBeluga model license ([link](https://huggingface.co/stabilityai/StableBeluga-7B)).
|
| 23 |
|
| 24 |
Please refer to the AWQ quantization license ([link](https://github.com/llm-awq/blob/main/LICENSE)).
|
| 25 |
|
|
|
|
| 41 |
```
|
| 42 |
|
| 43 |
```python
|
| 44 |
+
import time
|
| 45 |
import torch
|
| 46 |
from awq.quantize.quantizer import real_quantize_model_weight
|
| 47 |
from transformers import AutoModelForCausalLM, AutoConfig, AutoTokenizer, TextStreamer
|