TIGER-Lab
/

Mantis-8B-Fuyu

Text Generation

Inference Endpoints

Model card Files Files and versions Community

DongfuJiang commited on May 3

Commit

bfb4311

•

1 Parent(s): 22b8d75

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -66,7 +66,8 @@ model = MFuyuForCausalLM.from_pretrained("TIGER-Lab/Mantis-8B-Fuyu", device_map=
 generation_kwargs = {
     "max_new_tokens": 1024,
     "num_beams": 1,
-    "do_sample": False
 }
 # chat

 generation_kwargs = {
     "max_new_tokens": 1024,
     "num_beams": 1,
+    "do_sample": False,
+    "pad_token_id": processor.tokenizer.eos_token_id,
 }
 # chat