Abhinav Kulkarni commited on
Commit
1c126ae
1 Parent(s): 69f4c6e

Updated README

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -22,7 +22,7 @@ Please refer to the AWQ quantization license ([link](https://github.com/llm-awq/
22
 
23
  ## CUDA Version
24
 
25
- This model was successfully tested on CUDA driver v530.30.02 and runtime v11.7 with Python v3.10.11. Please note that AWQ requires NVIDIA GPUs with compute capability of 80 or higher.
26
 
27
  ## How to Use
28
 
@@ -81,7 +81,7 @@ output = model.generate(
81
  repetition_penalty=1.1,
82
  eos_token_id=tokenizer.eos_token_id
83
  )
84
- print(tokenizer.decode(output[0], skip_special_tokens=True))
85
  ```
86
 
87
  ## Evaluation
 
22
 
23
  ## CUDA Version
24
 
25
+ This model was successfully tested on CUDA driver v530.30.02 and runtime v11.7 with Python v3.10.11. Please note that AWQ requires NVIDIA GPUs with compute capability of `8.0` or higher.
26
 
27
  ## How to Use
28
 
 
81
  repetition_penalty=1.1,
82
  eos_token_id=tokenizer.eos_token_id
83
  )
84
+ # print(tokenizer.decode(output[0], skip_special_tokens=True))
85
  ```
86
 
87
  ## Evaluation