schuler
/

experimental-JP47D20

Text Generation

Model card Files Files and versions Community

schuler commited on Nov 25, 2024

Commit

774ce23

·

verified ·

1 Parent(s): 984aa88

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -25,7 +25,7 @@
   "num_hidden_layers": 4,
   "num_key_value_heads": 20,
   "original_max_position_embeddings": 4096,
-  "pad_token_id": 0,
   "resid_pdrop": 0.0,
   "rms_norm_eps": 1e-05,
   "rope_scaling": null,

   "num_hidden_layers": 4,
   "num_key_value_heads": 20,
   "original_max_position_embeddings": 4096,
+  "pad_token_id": 32000,
   "resid_pdrop": 0.0,
   "rms_norm_eps": 1e-05,
   "rope_scaling": null,