llama-2-7b-chat

Runtime error

pcuenq HF staff

ArthurZ HF staff commited on Jul 21, 2023

Commit

03883ed

•

1 Parent(s): db9ac27

Update model.py (#7)

- Update model.py (0e03aec07d9b55e5857eaa7c9586923573485280)

Co-authored-by: Arthur Zucker <[email protected]>

Files changed (1) hide show

model.py CHANGED Viewed

@@ -33,7 +33,7 @@ def get_prompt(message: str, chat_history: list[tuple[str, str]],
 def get_input_token_length(message: str, chat_history: list[tuple[str, str]], system_prompt: str) -> int:
     prompt = get_prompt(message, chat_history, system_prompt)
-    input_ids = tokenizer([prompt], return_tensors='np')['input_ids']
     return input_ids.shape[-1]

 def get_input_token_length(message: str, chat_history: list[tuple[str, str]], system_prompt: str) -> int:
     prompt = get_prompt(message, chat_history, system_prompt)
+    input_ids = tokenizer([prompt], return_tensors='np', add_special_tokens = False)['input_ids']
     return input_ids.shape[-1]