k-awtycarroll commited on
Commit
d477367
1 Parent(s): 6142912

my-great-gpt2-review-model-katie

Browse files
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
- base_model: distilgpt2
3
  license: apache-2.0
 
4
  tags:
5
  - generated_from_trainer
6
  model-index:
@@ -13,10 +13,10 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # my-great-gpt2-review-model-katie
15
 
16
- This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 3.8380
19
- - Model Preparation Time: 0.0014
20
 
21
  ## Model description
22
 
@@ -47,7 +47,7 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time |
49
  |:-------------:|:------:|:----:|:---------------:|:----------------------:|
50
- | 3.9332 | 0.3001 | 3045 | 3.8380 | 0.0014 |
51
 
52
 
53
  ### Framework versions
 
1
  ---
 
2
  license: apache-2.0
3
+ base_model: distilgpt2
4
  tags:
5
  - generated_from_trainer
6
  model-index:
 
13
 
14
  # my-great-gpt2-review-model-katie
15
 
16
+ This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.4783
19
+ - Model Preparation Time: 0.0023
20
 
21
  ## Model description
22
 
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time |
49
  |:-------------:|:------:|:----:|:---------------:|:----------------------:|
50
+ | 3.0411 | 0.3004 | 759 | 2.4783 | 0.0023 |
51
 
52
 
53
  ### Framework versions
config.json CHANGED
@@ -7,6 +7,7 @@
7
  ],
8
  "attn_pdrop": 0.1,
9
  "bos_token_id": 50256,
 
10
  "embd_pdrop": 0.1,
11
  "eos_token_id": 50256,
12
  "id2label": {
@@ -17,6 +18,7 @@
17
  "LABEL_0": 0
18
  },
19
  "layer_norm_epsilon": 1e-05,
 
20
  "model_type": "gpt2",
21
  "n_ctx": 1024,
22
  "n_embd": 768,
 
7
  ],
8
  "attn_pdrop": 0.1,
9
  "bos_token_id": 50256,
10
+ "do_sample": true,
11
  "embd_pdrop": 0.1,
12
  "eos_token_id": 50256,
13
  "id2label": {
 
18
  "LABEL_0": 0
19
  },
20
  "layer_norm_epsilon": 1e-05,
21
+ "max_length": 50,
22
  "model_type": "gpt2",
23
  "n_ctx": 1024,
24
  "n_embd": 768,
runs/Aug15_13-31-28_d587c0aa5f9f/events.out.tfevents.1723728910.d587c0aa5f9f.6010.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e142a9f728c8840a504c1515025fcff4d6de9ffd7ea1f8a063a3b2f7aed2b96
3
+ size 425