Spaces:

gsvc
/

krish-sri-bot

Running

chgsvc2 commited on Sep 12, 2023

Commit

260318a

•

1 Parent(s): 1107a86

Added necessary files

Files changed (1) hide show

config.py CHANGED Viewed

@@ -18,8 +18,7 @@ Helpful answer:
 INP_VARS = ['context', 'question']
 CHAIN_TYPE = "stuff"
 SEARCH_KWARGS = {'k': 2}
-MODEL_CKPT = "res/llama-2-7b-chat.ggmlv3.q4_1.bin"
 MODEL_TYPE = "llama"
 MAX_NEW_TOKENS = 512
 TEMPERATURE = 0.9

 INP_VARS = ['context', 'question']
 CHAIN_TYPE = "stuff"
 SEARCH_KWARGS = {'k': 2}
+MODEL_CKPT = "res/llama-2-7b-chat.ggmlv3.q2_K.bin"
 MODEL_TYPE = "llama"
 MAX_NEW_TOKENS = 512
 TEMPERATURE = 0.9