abhinavkulkarni
/

tiiuae-falcon-7b-instruct-w4-g64-awq

Text Generation

RefinedWebModel

text-generation-inference

Model card Files Files and versions Community

Abhinav Kulkarni commited on Jul 19, 2023

Commit

0e35b4c

•

1 Parent(s): 98fc77e

Updated README

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -81,8 +81,7 @@ output = model.generate(
     top_k=0,
     repetition_penalty=1.1,
     eos_token_id=tokenizer.eos_token_id,
-streamer=streamer
-)
 ```
 ## Evaluation

     top_k=0,
     repetition_penalty=1.1,
     eos_token_id=tokenizer.eos_token_id,
+    streamer=streamer)
 ```
 ## Evaluation