Hugging Face's logo

Spaces:
Slycat
/
Neural-Chat-Southampton
Runtime error

App Files Community
Warlord-K commited on
Commit
45fa057
·
1 Parent(s): 7034630

Change Max new tokens

Browse files
Files changed (1) hide show
  1. app.py +2 -2
app.py CHANGED
@@ -15,8 +15,8 @@ from transformers import AutoTokenizer
15
 
16
  huggingface.prompt_builder = "llama2"
17
  huggingface.api_key = os.environ["HUGGINGFACE_TOKEN"]
18
- MAX_MAX_NEW_TOKENS = 2048
19
- DEFAULT_MAX_NEW_TOKENS = 1024
20
  MAX_INPUT_TOKEN_LENGTH = 4000
21
  EMBED_DIM = 1024
22
  K = 10
 
15
 
16
  huggingface.prompt_builder = "llama2"
17
  huggingface.api_key = os.environ["HUGGINGFACE_TOKEN"]
18
+ MAX_MAX_NEW_TOKENS = 250
19
+ DEFAULT_MAX_NEW_TOKENS = 250
20
  MAX_INPUT_TOKEN_LENGTH = 4000
21
  EMBED_DIM = 1024
22
  K = 10