Update README.md
Browse files
README.md
CHANGED
@@ -34,21 +34,21 @@ con el fin de almacenar de manera temoporal el modelo que pesa alrededor de 35 G
|
|
34 |
|
35 |
|
36 |
The following hyperparameters were used during training:
|
37 |
-
|
38 |
-
|
39 |
-
|
40 |
-
|
41 |
-
|
42 |
-
|
43 |
-
|
44 |
-
|
45 |
-
|
46 |
-
|
47 |
-
|
48 |
-
|
49 |
-
|
50 |
-
|
51 |
-
|
52 |
|
53 |
|
54 |
|
|
|
34 |
|
35 |
|
36 |
The following hyperparameters were used during training:
|
37 |
+
- eval_strategy="epoch",
|
38 |
+
- save_strategy="epoch",
|
39 |
+
- learning_rate=2e-5, # (Aprendizaje se esta cambiando)
|
40 |
+
- per_device_train_batch_size=16,
|
41 |
+
- per_device_eval_batch_size=16,
|
42 |
+
- num_train_epochs=5,
|
43 |
+
- weight_decay=0.1,
|
44 |
+
- max_grad_norm=1.0,
|
45 |
+
- adam_epsilon=1e-5,
|
46 |
+
- fp16=True,
|
47 |
+
- save_total_limit=2,
|
48 |
+
- load_best_model_at_end=True,
|
49 |
+
- push_to_hub=True,
|
50 |
+
- metric_for_best_model="f1",
|
51 |
+
- seed=42,
|
52 |
|
53 |
|
54 |
|