ichetandhembre
/

chat_lora_unsloth_wikipedia_qa_train_4_bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

ichetandhembre commited on Mar 19

Commit

9364246

•

1 Parent(s): e2401f1

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -30,7 +30,7 @@
     },
     "rms_norm_eps": 0.00001,
     "rope_theta": 10000,
-    "sliding_window": 4096,
     "tie_word_embeddings": false,
     "torch_dtype": "float16",
     "transformers_version": "4.38.2",

     },
     "rms_norm_eps": 0.00001,
     "rope_theta": 10000,
+    "sliding_window": null,
     "tie_word_embeddings": false,
     "torch_dtype": "float16",
     "transformers_version": "4.38.2",