End of training

README.md

@@ -0,0 +1,60 @@
+---
+license: mit
+base_model: microsoft/deberta-base
+tags:
+- generated_from_trainer
+model-index:
+- name: DebertaMLMnc2c
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# DebertaMLMnc2c
+
+This model is a fine-tuned version of [microsoft/deberta-base](https://huggingface.co/microsoft/deberta-base) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.0107
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3.0
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 3.7415        | 1.0   | 1840 | 1.9151          |
+| 2.417         | 2.0   | 3680 | 1.4787          |
+| 2.1174        | 3.0   | 5520 | 1.1759          |
+
+
+### Framework versions
+
+- Transformers 4.35.2
+- Pytorch 2.1.0+cu121
+- Datasets 2.15.0
+- Tokenizers 0.15.0

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f75acd64a5ad2dbbba37f27e0146bd4797f041bf98424d697e55a1c7f60b0cdc
+oid sha256:c3672f3de2911b2744514d76adaaaa77ee9d7c950f98e350e0b66cb0040f2249
 size 557000804

runs/Dec16_18-13-48_86962031a22f/events.out.tfevents.1702750434.86962031a22f.557.1

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e47367e524e9ba53a9706b4e3c433da1f3ad0b1c1e2f35200a6d7c03f2117674
-size 5319
+oid sha256:44e2785ea2d5facaac2a8d4112ce05020bc80be55e10f4ab5b8b3bc34a8fb08d
+size 6101

runs/Dec16_18-13-48_86962031a22f/events.out.tfevents.1702751737.86962031a22f.557.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:40804591da221639a578b064b616daaab4c0264aca979f58ee017aceefd03b3f
+size 359