headlines_news_sentiment_distil

README.md

@@ -19,10 +19,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.7839
-- Model Preparation Time: 0.0033
-- Accuracy: 0.8320
-- F1: 0.8319
+- Loss: 0.6265
+- Model Preparation Time: 0.0026
+- Accuracy: 0.8423
+- F1: 0.8423
 
 ## Model description
 
@@ -47,16 +47,17 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 4
+- num_epochs: 5
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Accuracy | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:----------------------:|:--------:|:------:|
-| 0.0132        | 1.0   | 504  | 1.8941          | 0.0033                 | 0.8244   | 0.8234 |
-| 0.0071        | 2.0   | 1008 | 1.7813          | 0.0033                 | 0.8244   | 0.8244 |
-| 0.0085        | 3.0   | 1512 | 1.7540          | 0.0033                 | 0.8337   | 0.8337 |
-| 0.001         | 4.0   | 2016 | 1.7839          | 0.0033                 | 0.8320   | 0.8319 |
+| 0.4834        | 1.0   | 504  | 0.4035          | 0.0026                 | 0.8156   | 0.8156 |
+| 0.3402        | 2.0   | 1008 | 0.3987          | 0.0026                 | 0.8343   | 0.8343 |
+| 0.2343        | 3.0   | 1512 | 0.4514          | 0.0026                 | 0.8392   | 0.8391 |
+| 0.1604        | 4.0   | 2016 | 0.5443          | 0.0026                 | 0.8396   | 0.8396 |
+| 0.1151        | 5.0   | 2520 | 0.6265          | 0.0026                 | 0.8423   | 0.8423 |
 
 
 ### Framework versions

runs/Sep11_04-22-44_c9e2a75fea34/events.out.tfevents.1726028572.c9e2a75fea34.8923.15

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9f4b3bedaa33fed23dc00bfd69ea7a6fee303690bcb02c046092df35393fc5fe
-size 8049
+oid sha256:62c3a3cca07bbca9ecf65540c60272c774a5d4c335a6237785d61e5da95e00a9
+size 8838