erlend123 commited on
Commit
24dd232
·
verified ·
1 Parent(s): e4d496f

End of training

Browse files
README.md CHANGED
@@ -6,8 +6,6 @@ tags:
6
  - generated_from_trainer
7
  datasets:
8
  - imagefolder
9
- metrics:
10
- - accuracy
11
  model-index:
12
  - name: PG2-28b-pt-448-COND_GEN
13
  results: []
@@ -19,9 +17,6 @@ should probably proofread and complete it, then remove this comment. -->
19
  # PG2-28b-pt-448-COND_GEN
20
 
21
  This model is a fine-tuned version of [google/paligemma2-28b-pt-448](https://huggingface.co/google/paligemma2-28b-pt-448) on the imagefolder dataset.
22
- It achieves the following results on the evaluation set:
23
- - Loss: 0.0000
24
- - Accuracy: 0.0
25
 
26
  ## Model description
27
 
@@ -47,31 +42,10 @@ The following hyperparameters were used during training:
47
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
  - lr_scheduler_type: linear
49
  - lr_scheduler_warmup_steps: 2
50
- - num_epochs: 2
51
 
52
  ### Training results
53
 
54
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
55
- |:-------------:|:------:|:----:|:---------------:|:--------:|
56
- | 0.4437 | 0.1001 | 200 | 0.0036 | 1.0 |
57
- | 0.3054 | 0.2001 | 400 | 0.0002 | 1.0 |
58
- | 0.3504 | 0.3002 | 600 | 0.0001 | 1.0 |
59
- | 0.2364 | 0.4002 | 800 | 0.0001 | 0.0 |
60
- | 0.257 | 0.5003 | 1000 | 0.0001 | 0.0 |
61
- | 0.3007 | 0.6003 | 1200 | 0.0002 | 0.0 |
62
- | 0.2468 | 0.7004 | 1400 | 0.0001 | 0.0 |
63
- | 0.278 | 0.8004 | 1600 | 0.0001 | 0.0 |
64
- | 0.2576 | 0.9005 | 1800 | 0.0001 | 0.0 |
65
- | 0.3052 | 1.0005 | 2000 | 0.0005 | 0.0 |
66
- | 0.0982 | 1.1006 | 2200 | 0.0001 | 0.0 |
67
- | 0.103 | 1.2006 | 2400 | 0.0001 | 0.0 |
68
- | 0.1191 | 1.3007 | 2600 | 0.0001 | 0.0 |
69
- | 0.1137 | 1.4007 | 2800 | 0.0001 | 1.0 |
70
- | 0.1567 | 1.5008 | 3000 | 0.0001 | 0.0 |
71
- | 0.0758 | 1.6008 | 3200 | 0.0000 | 0.0 |
72
- | 0.0969 | 1.7009 | 3400 | 0.0001 | 0.0 |
73
- | 0.1034 | 1.8009 | 3600 | 0.0000 | 0.0 |
74
- | 0.0513 | 1.9010 | 3800 | 0.0000 | 0.0 |
75
 
76
 
77
  ### Framework versions
 
6
  - generated_from_trainer
7
  datasets:
8
  - imagefolder
 
 
9
  model-index:
10
  - name: PG2-28b-pt-448-COND_GEN
11
  results: []
 
17
  # PG2-28b-pt-448-COND_GEN
18
 
19
  This model is a fine-tuned version of [google/paligemma2-28b-pt-448](https://huggingface.co/google/paligemma2-28b-pt-448) on the imagefolder dataset.
 
 
 
20
 
21
  ## Model description
22
 
 
42
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
  - lr_scheduler_type: linear
44
  - lr_scheduler_warmup_steps: 2
45
+ - num_epochs: 0.0005
46
 
47
  ### Training results
48
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
 
50
 
51
  ### Framework versions
adapter_config.json CHANGED
@@ -25,11 +25,11 @@
25
  "target_modules": [
26
  "k_proj",
27
  "q_proj",
28
- "v_proj",
29
  "up_proj",
 
30
  "gate_proj",
31
- "down_proj",
32
- "o_proj"
33
  ],
34
  "task_type": "CAUSAL_LM",
35
  "use_dora": false,
 
25
  "target_modules": [
26
  "k_proj",
27
  "q_proj",
 
28
  "up_proj",
29
+ "v_proj",
30
  "gate_proj",
31
+ "o_proj",
32
+ "down_proj"
33
  ],
34
  "task_type": "CAUSAL_LM",
35
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60d95b10b6e140a9626a7058d5038528f2ff80148dc4569b881db56052046509
3
- size 40
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d12180845e55b2f3c08ed3c6fb390b0763bc38e1252b1454b7be82f1e82dd6dc
3
+ size 234454320
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7eb5b088c2cc81b391c8093863149b0835375bf271c755308ca11b40e1484c5c
3
  size 5368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b330f0cfb1c3a8787840edf2ccb59935a6383f572809112ee47a8e5f862e2541
3
  size 5368