Hugging Face's logo

MuhammedYahia
/
CodeGen_2B_Security

PEFT
Model card Files Community
MuhammedYahia commited on
Commit
431512f
•
1 Parent(s): 32cc97d

Upload 8 files

Browse files

codeGen 2B fine tuned for security tasks

Files changed (8) hide show
  1. README.md +202 -1
  2. adapter_config.json +29 -0
  3. adapter_model.bin +3 -0
  4. optimizer.pt +3 -0
  5. rng_state.pth +3 -0
  6. scheduler.pt +3 -0
  7. trainer_state.json +3715 -0
  8. training_args.bin +3 -0
README.md CHANGED
@@ -1,3 +1,204 @@
1
  ---
2
- license: mit
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: peft
3
+ base_model: Salesforce/codegen2-1B
4
  ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+
201
+
202
+ ### Framework versions
203
+
204
+ - PEFT 0.7.1
adapter_config.json ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "Salesforce/codegen2-1B",
5
+ "bias": "all",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layers_pattern": null,
10
+ "layers_to_transform": null,
11
+ "loftq_config": {},
12
+ "lora_alpha": 128,
13
+ "lora_dropout": 0.05,
14
+ "megatron_config": null,
15
+ "megatron_core": "megatron.core",
16
+ "modules_to_save": null,
17
+ "peft_type": "LORA",
18
+ "r": 64,
19
+ "rank_pattern": {},
20
+ "revision": null,
21
+ "target_modules": [
22
+ "out_proj",
23
+ "fc_in",
24
+ "fc_out",
25
+ "qkv_proj",
26
+ "lm_head"
27
+ ],
28
+ "task_type": "CAUSAL_LM"
29
+ }
adapter_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1ba896be8b1b798f7ec7ce55dbc48c2d340cbc00383c0ee95c11cdddca4f3a0
3
+ size 568341207
optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8c8a12611ad512b5c9e057d76443f1c78de6a6bfb4dfdd2319790bdda267728
3
+ size 297846537
rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:191fb73f7209d2322d53ef5d068341c2553deb344849bb0fb0cad44967fb19f9
3
+ size 14503
scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2de148b7c8c65d4a21f47e016624a4f06d0b279dc8771342a1ba1d3e5fa2681
3
+ size 623
trainer_state.json ADDED
@@ -0,0 +1,3715 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 0.06,
5
+ "eval_steps": 50,
6
+ "global_step": 600,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.0,
13
+ "learning_rate": 5.000000000000001e-07,
14
+ "loss": 1.0306,
15
+ "step": 1
16
+ },
17
+ {
18
+ "epoch": 0.0,
19
+ "learning_rate": 1.0000000000000002e-06,
20
+ "loss": 0.9796,
21
+ "step": 2
22
+ },
23
+ {
24
+ "epoch": 0.0,
25
+ "learning_rate": 1.5e-06,
26
+ "loss": 1.1645,
27
+ "step": 3
28
+ },
29
+ {
30
+ "epoch": 0.0,
31
+ "learning_rate": 2.0000000000000003e-06,
32
+ "loss": 0.6227,
33
+ "step": 4
34
+ },
35
+ {
36
+ "epoch": 0.0,
37
+ "learning_rate": 2.5e-06,
38
+ "loss": 0.9588,
39
+ "step": 5
40
+ },
41
+ {
42
+ "epoch": 0.0,
43
+ "learning_rate": 3e-06,
44
+ "loss": 0.806,
45
+ "step": 6
46
+ },
47
+ {
48
+ "epoch": 0.0,
49
+ "learning_rate": 3.5000000000000004e-06,
50
+ "loss": 1.1137,
51
+ "step": 7
52
+ },
53
+ {
54
+ "epoch": 0.0,
55
+ "learning_rate": 4.000000000000001e-06,
56
+ "loss": 0.8787,
57
+ "step": 8
58
+ },
59
+ {
60
+ "epoch": 0.0,
61
+ "learning_rate": 4.5e-06,
62
+ "loss": 0.8552,
63
+ "step": 9
64
+ },
65
+ {
66
+ "epoch": 0.0,
67
+ "learning_rate": 5e-06,
68
+ "loss": 1.0622,
69
+ "step": 10
70
+ },
71
+ {
72
+ "epoch": 0.0,
73
+ "learning_rate": 5.500000000000001e-06,
74
+ "loss": 1.0613,
75
+ "step": 11
76
+ },
77
+ {
78
+ "epoch": 0.0,
79
+ "learning_rate": 6e-06,
80
+ "loss": 0.6159,
81
+ "step": 12
82
+ },
83
+ {
84
+ "epoch": 0.0,
85
+ "learning_rate": 6.5000000000000004e-06,
86
+ "loss": 1.0281,
87
+ "step": 13
88
+ },
89
+ {
90
+ "epoch": 0.0,
91
+ "learning_rate": 7.000000000000001e-06,
92
+ "loss": 1.0413,
93
+ "step": 14
94
+ },
95
+ {
96
+ "epoch": 0.0,
97
+ "learning_rate": 7.5e-06,
98
+ "loss": 0.7431,
99
+ "step": 15
100
+ },
101
+ {
102
+ "epoch": 0.0,
103
+ "learning_rate": 8.000000000000001e-06,
104
+ "loss": 0.8156,
105
+ "step": 16
106
+ },
107
+ {
108
+ "epoch": 0.0,
109
+ "learning_rate": 8.500000000000002e-06,
110
+ "loss": 0.7001,
111
+ "step": 17
112
+ },
113
+ {
114
+ "epoch": 0.0,
115
+ "learning_rate": 9e-06,
116
+ "loss": 1.1875,
117
+ "step": 18
118
+ },
119
+ {
120
+ "epoch": 0.0,
121
+ "learning_rate": 9.5e-06,
122
+ "loss": 0.9966,
123
+ "step": 19
124
+ },
125
+ {
126
+ "epoch": 0.0,
127
+ "learning_rate": 1e-05,
128
+ "loss": 1.0371,
129
+ "step": 20
130
+ },
131
+ {
132
+ "epoch": 0.0,
133
+ "learning_rate": 1.05e-05,
134
+ "loss": 1.1584,
135
+ "step": 21
136
+ },
137
+ {
138
+ "epoch": 0.0,
139
+ "learning_rate": 1.1000000000000001e-05,
140
+ "loss": 0.7505,
141
+ "step": 22
142
+ },
143
+ {
144
+ "epoch": 0.0,
145
+ "learning_rate": 1.1500000000000002e-05,
146
+ "loss": 1.066,
147
+ "step": 23
148
+ },
149
+ {
150
+ "epoch": 0.0,
151
+ "learning_rate": 1.2e-05,
152
+ "loss": 1.1298,
153
+ "step": 24
154
+ },
155
+ {
156
+ "epoch": 0.0,
157
+ "learning_rate": 1.25e-05,
158
+ "loss": 1.068,
159
+ "step": 25
160
+ },
161
+ {
162
+ "epoch": 0.0,
163
+ "learning_rate": 1.3000000000000001e-05,
164
+ "loss": 1.1175,
165
+ "step": 26
166
+ },
167
+ {
168
+ "epoch": 0.0,
169
+ "learning_rate": 1.3500000000000001e-05,
170
+ "loss": 0.573,
171
+ "step": 27
172
+ },
173
+ {
174
+ "epoch": 0.0,
175
+ "learning_rate": 1.4000000000000001e-05,
176
+ "loss": 0.8054,
177
+ "step": 28
178
+ },
179
+ {
180
+ "epoch": 0.0,
181
+ "learning_rate": 1.45e-05,
182
+ "loss": 1.1083,
183
+ "step": 29
184
+ },
185
+ {
186
+ "epoch": 0.0,
187
+ "learning_rate": 1.5e-05,
188
+ "loss": 1.1453,
189
+ "step": 30
190
+ },
191
+ {
192
+ "epoch": 0.0,
193
+ "learning_rate": 1.55e-05,
194
+ "loss": 1.5355,
195
+ "step": 31
196
+ },
197
+ {
198
+ "epoch": 0.0,
199
+ "learning_rate": 1.6000000000000003e-05,
200
+ "loss": 0.9017,
201
+ "step": 32
202
+ },
203
+ {
204
+ "epoch": 0.0,
205
+ "learning_rate": 1.65e-05,
206
+ "loss": 0.7989,
207
+ "step": 33
208
+ },
209
+ {
210
+ "epoch": 0.0,
211
+ "learning_rate": 1.7000000000000003e-05,
212
+ "loss": 0.1186,
213
+ "step": 34
214
+ },
215
+ {
216
+ "epoch": 0.0,
217
+ "learning_rate": 1.75e-05,
218
+ "loss": 0.0789,
219
+ "step": 35
220
+ },
221
+ {
222
+ "epoch": 0.0,
223
+ "learning_rate": 1.8e-05,
224
+ "loss": 0.1037,
225
+ "step": 36
226
+ },
227
+ {
228
+ "epoch": 0.0,
229
+ "learning_rate": 1.85e-05,
230
+ "loss": 0.08,
231
+ "step": 37
232
+ },
233
+ {
234
+ "epoch": 0.0,
235
+ "learning_rate": 1.9e-05,
236
+ "loss": 0.0584,
237
+ "step": 38
238
+ },
239
+ {
240
+ "epoch": 0.0,
241
+ "learning_rate": 1.9500000000000003e-05,
242
+ "loss": 0.0915,
243
+ "step": 39
244
+ },
245
+ {
246
+ "epoch": 0.0,
247
+ "learning_rate": 2e-05,
248
+ "loss": 0.0727,
249
+ "step": 40
250
+ },
251
+ {
252
+ "epoch": 0.0,
253
+ "learning_rate": 2.05e-05,
254
+ "loss": 0.0553,
255
+ "step": 41
256
+ },
257
+ {
258
+ "epoch": 0.0,
259
+ "learning_rate": 2.1e-05,
260
+ "loss": 0.0679,
261
+ "step": 42
262
+ },
263
+ {
264
+ "epoch": 0.0,
265
+ "learning_rate": 2.15e-05,
266
+ "loss": 0.0599,
267
+ "step": 43
268
+ },
269
+ {
270
+ "epoch": 0.0,
271
+ "learning_rate": 2.2000000000000003e-05,
272
+ "loss": 0.0517,
273
+ "step": 44
274
+ },
275
+ {
276
+ "epoch": 0.0,
277
+ "learning_rate": 2.25e-05,
278
+ "loss": 0.1149,
279
+ "step": 45
280
+ },
281
+ {
282
+ "epoch": 0.0,
283
+ "learning_rate": 2.3000000000000003e-05,
284
+ "loss": 0.054,
285
+ "step": 46
286
+ },
287
+ {
288
+ "epoch": 0.0,
289
+ "learning_rate": 2.35e-05,
290
+ "loss": 0.0399,
291
+ "step": 47
292
+ },
293
+ {
294
+ "epoch": 0.0,
295
+ "learning_rate": 2.4e-05,
296
+ "loss": 0.0508,
297
+ "step": 48
298
+ },
299
+ {
300
+ "epoch": 0.0,
301
+ "learning_rate": 2.45e-05,
302
+ "loss": 0.0436,
303
+ "step": 49
304
+ },
305
+ {
306
+ "epoch": 0.01,
307
+ "learning_rate": 2.5e-05,
308
+ "loss": 0.0405,
309
+ "step": 50
310
+ },
311
+ {
312
+ "epoch": 0.01,
313
+ "eval_loss": 1.051814079284668,
314
+ "eval_runtime": 33.2954,
315
+ "eval_samples_per_second": 2.553,
316
+ "eval_steps_per_second": 0.661,
317
+ "step": 50
318
+ },
319
+ {
320
+ "epoch": 0.01,
321
+ "learning_rate": 2.5500000000000003e-05,
322
+ "loss": 0.298,
323
+ "step": 51
324
+ },
325
+ {
326
+ "epoch": 0.01,
327
+ "learning_rate": 2.6000000000000002e-05,
328
+ "loss": 0.5977,
329
+ "step": 52
330
+ },
331
+ {
332
+ "epoch": 0.01,
333
+ "learning_rate": 2.6500000000000004e-05,
334
+ "loss": 0.9878,
335
+ "step": 53
336
+ },
337
+ {
338
+ "epoch": 0.01,
339
+ "learning_rate": 2.7000000000000002e-05,
340
+ "loss": 0.7903,
341
+ "step": 54
342
+ },
343
+ {
344
+ "epoch": 0.01,
345
+ "learning_rate": 2.7500000000000004e-05,
346
+ "loss": 1.0548,
347
+ "step": 55
348
+ },
349
+ {
350
+ "epoch": 0.01,
351
+ "learning_rate": 2.8000000000000003e-05,
352
+ "loss": 0.9161,
353
+ "step": 56
354
+ },
355
+ {
356
+ "epoch": 0.01,
357
+ "learning_rate": 2.8499999999999998e-05,
358
+ "loss": 1.3686,
359
+ "step": 57
360
+ },
361
+ {
362
+ "epoch": 0.01,
363
+ "learning_rate": 2.9e-05,
364
+ "loss": 1.7704,
365
+ "step": 58
366
+ },
367
+ {
368
+ "epoch": 0.01,
369
+ "learning_rate": 2.95e-05,
370
+ "loss": 1.0523,
371
+ "step": 59
372
+ },
373
+ {
374
+ "epoch": 0.01,
375
+ "learning_rate": 3e-05,
376
+ "loss": 1.191,
377
+ "step": 60
378
+ },
379
+ {
380
+ "epoch": 0.01,
381
+ "learning_rate": 3.05e-05,
382
+ "loss": 1.2224,
383
+ "step": 61
384
+ },
385
+ {
386
+ "epoch": 0.01,
387
+ "learning_rate": 3.1e-05,
388
+ "loss": 1.3556,
389
+ "step": 62
390
+ },
391
+ {
392
+ "epoch": 0.01,
393
+ "learning_rate": 3.15e-05,
394
+ "loss": 1.1368,
395
+ "step": 63
396
+ },
397
+ {
398
+ "epoch": 0.01,
399
+ "learning_rate": 3.2000000000000005e-05,
400
+ "loss": 1.2531,
401
+ "step": 64
402
+ },
403
+ {
404
+ "epoch": 0.01,
405
+ "learning_rate": 3.2500000000000004e-05,
406
+ "loss": 1.2027,
407
+ "step": 65
408
+ },
409
+ {
410
+ "epoch": 0.01,
411
+ "learning_rate": 3.3e-05,
412
+ "loss": 1.0789,
413
+ "step": 66
414
+ },
415
+ {
416
+ "epoch": 0.01,
417
+ "learning_rate": 3.35e-05,
418
+ "loss": 1.3288,
419
+ "step": 67
420
+ },
421
+ {
422
+ "epoch": 0.01,
423
+ "learning_rate": 3.4000000000000007e-05,
424
+ "loss": 0.9706,
425
+ "step": 68
426
+ },
427
+ {
428
+ "epoch": 0.01,
429
+ "learning_rate": 3.45e-05,
430
+ "loss": 0.832,
431
+ "step": 69
432
+ },
433
+ {
434
+ "epoch": 0.01,
435
+ "learning_rate": 3.5e-05,
436
+ "loss": 0.8661,
437
+ "step": 70
438
+ },
439
+ {
440
+ "epoch": 0.01,
441
+ "learning_rate": 3.55e-05,
442
+ "loss": 2.438,
443
+ "step": 71
444
+ },
445
+ {
446
+ "epoch": 0.01,
447
+ "learning_rate": 3.6e-05,
448
+ "loss": 1.3327,
449
+ "step": 72
450
+ },
451
+ {
452
+ "epoch": 0.01,
453
+ "learning_rate": 3.65e-05,
454
+ "loss": 1.1495,
455
+ "step": 73
456
+ },
457
+ {
458
+ "epoch": 0.01,
459
+ "learning_rate": 3.7e-05,
460
+ "loss": 1.2341,
461
+ "step": 74
462
+ },
463
+ {
464
+ "epoch": 0.01,
465
+ "learning_rate": 3.7500000000000003e-05,
466
+ "loss": 1.1848,
467
+ "step": 75
468
+ },
469
+ {
470
+ "epoch": 0.01,
471
+ "learning_rate": 3.8e-05,
472
+ "loss": 1.3687,
473
+ "step": 76
474
+ },
475
+ {
476
+ "epoch": 0.01,
477
+ "learning_rate": 3.85e-05,
478
+ "loss": 1.1204,
479
+ "step": 77
480
+ },
481
+ {
482
+ "epoch": 0.01,
483
+ "learning_rate": 3.9000000000000006e-05,
484
+ "loss": 1.1608,
485
+ "step": 78
486
+ },
487
+ {
488
+ "epoch": 0.01,
489
+ "learning_rate": 3.9500000000000005e-05,
490
+ "loss": 1.1442,
491
+ "step": 79
492
+ },
493
+ {
494
+ "epoch": 0.01,
495
+ "learning_rate": 4e-05,
496
+ "loss": 0.9808,
497
+ "step": 80
498
+ },
499
+ {
500
+ "epoch": 0.01,
501
+ "learning_rate": 4.05e-05,
502
+ "loss": 1.0513,
503
+ "step": 81
504
+ },
505
+ {
506
+ "epoch": 0.01,
507
+ "learning_rate": 4.1e-05,
508
+ "loss": 1.3775,
509
+ "step": 82
510
+ },
511
+ {
512
+ "epoch": 0.01,
513
+ "learning_rate": 4.15e-05,
514
+ "loss": 0.6558,
515
+ "step": 83
516
+ },
517
+ {
518
+ "epoch": 0.01,
519
+ "learning_rate": 4.2e-05,
520
+ "loss": 1.1873,
521
+ "step": 84
522
+ },
523
+ {
524
+ "epoch": 0.01,
525
+ "learning_rate": 4.25e-05,
526
+ "loss": 1.0167,
527
+ "step": 85
528
+ },
529
+ {
530
+ "epoch": 0.01,
531
+ "learning_rate": 4.3e-05,
532
+ "loss": 1.0519,
533
+ "step": 86
534
+ },
535
+ {
536
+ "epoch": 0.01,
537
+ "learning_rate": 4.35e-05,
538
+ "loss": 0.9843,
539
+ "step": 87
540
+ },
541
+ {
542
+ "epoch": 0.01,
543
+ "learning_rate": 4.4000000000000006e-05,
544
+ "loss": 1.1445,
545
+ "step": 88
546
+ },
547
+ {
548
+ "epoch": 0.01,
549
+ "learning_rate": 4.4500000000000004e-05,
550
+ "loss": 1.0606,
551
+ "step": 89
552
+ },
553
+ {
554
+ "epoch": 0.01,
555
+ "learning_rate": 4.5e-05,
556
+ "loss": 1.0714,
557
+ "step": 90
558
+ },
559
+ {
560
+ "epoch": 0.01,
561
+ "learning_rate": 4.55e-05,
562
+ "loss": 0.999,
563
+ "step": 91
564
+ },
565
+ {
566
+ "epoch": 0.01,
567
+ "learning_rate": 4.600000000000001e-05,
568
+ "loss": 0.8138,
569
+ "step": 92
570
+ },
571
+ {
572
+ "epoch": 0.01,
573
+ "learning_rate": 4.6500000000000005e-05,
574
+ "loss": 0.8204,
575
+ "step": 93
576
+ },
577
+ {
578
+ "epoch": 0.01,
579
+ "learning_rate": 4.7e-05,
580
+ "loss": 1.289,
581
+ "step": 94
582
+ },
583
+ {
584
+ "epoch": 0.01,
585
+ "learning_rate": 4.75e-05,
586
+ "loss": 1.1554,
587
+ "step": 95
588
+ },
589
+ {
590
+ "epoch": 0.01,
591
+ "learning_rate": 4.8e-05,
592
+ "loss": 1.2538,
593
+ "step": 96
594
+ },
595
+ {
596
+ "epoch": 0.01,
597
+ "learning_rate": 4.85e-05,
598
+ "loss": 1.6712,
599
+ "step": 97
600
+ },
601
+ {
602
+ "epoch": 0.01,
603
+ "learning_rate": 4.9e-05,
604
+ "loss": 0.8988,
605
+ "step": 98
606
+ },
607
+ {
608
+ "epoch": 0.01,
609
+ "learning_rate": 4.9500000000000004e-05,
610
+ "loss": 1.0097,
611
+ "step": 99
612
+ },
613
+ {
614
+ "epoch": 0.01,
615
+ "learning_rate": 5e-05,
616
+ "loss": 0.9292,
617
+ "step": 100
618
+ },
619
+ {
620
+ "epoch": 0.01,
621
+ "eval_loss": 1.024911642074585,
622
+ "eval_runtime": 33.8827,
623
+ "eval_samples_per_second": 2.509,
624
+ "eval_steps_per_second": 0.649,
625
+ "step": 100
626
+ },
627
+ {
628
+ "epoch": 0.01,
629
+ "learning_rate": 4.999999874125034e-05,
630
+ "loss": 1.0641,
631
+ "step": 101
632
+ },
633
+ {
634
+ "epoch": 0.01,
635
+ "learning_rate": 4.9999994965001495e-05,
636
+ "loss": 1.2151,
637
+ "step": 102
638
+ },
639
+ {
640
+ "epoch": 0.01,
641
+ "learning_rate": 4.999998867125384e-05,
642
+ "loss": 1.1987,
643
+ "step": 103
644
+ },
645
+ {
646
+ "epoch": 0.01,
647
+ "learning_rate": 4.9999979860008006e-05,
648
+ "loss": 0.9532,
649
+ "step": 104
650
+ },
651
+ {
652
+ "epoch": 0.01,
653
+ "learning_rate": 4.999996853126489e-05,
654
+ "loss": 0.9377,
655
+ "step": 105
656
+ },
657
+ {
658
+ "epoch": 0.01,
659
+ "learning_rate": 4.999995468502562e-05,
660
+ "loss": 1.0075,
661
+ "step": 106
662
+ },
663
+ {
664
+ "epoch": 0.01,
665
+ "learning_rate": 4.9999938321291604e-05,
666
+ "loss": 1.085,
667
+ "step": 107
668
+ },
669
+ {
670
+ "epoch": 0.01,
671
+ "learning_rate": 4.999991944006448e-05,
672
+ "loss": 0.9276,
673
+ "step": 108
674
+ },
675
+ {
676
+ "epoch": 0.01,
677
+ "learning_rate": 4.9999898041346155e-05,
678
+ "loss": 0.7739,
679
+ "step": 109
680
+ },
681
+ {
682
+ "epoch": 0.01,
683
+ "learning_rate": 4.999987412513878e-05,
684
+ "loss": 0.0642,
685
+ "step": 110
686
+ },
687
+ {
688
+ "epoch": 0.01,
689
+ "learning_rate": 4.999984769144476e-05,
690
+ "loss": 0.0386,
691
+ "step": 111
692
+ },
693
+ {
694
+ "epoch": 0.01,
695
+ "learning_rate": 4.9999818740266766e-05,
696
+ "loss": 0.045,
697
+ "step": 112
698
+ },
699
+ {
700
+ "epoch": 0.01,
701
+ "learning_rate": 4.9999787271607714e-05,
702
+ "loss": 0.0305,
703
+ "step": 113
704
+ },
705
+ {
706
+ "epoch": 0.01,
707
+ "learning_rate": 4.999975328547076e-05,
708
+ "loss": 0.0297,
709
+ "step": 114
710
+ },
711
+ {
712
+ "epoch": 0.01,
713
+ "learning_rate": 4.999971678185933e-05,
714
+ "loss": 0.0315,
715
+ "step": 115
716
+ },
717
+ {
718
+ "epoch": 0.01,
719
+ "learning_rate": 4.9999677760777114e-05,
720
+ "loss": 0.0375,
721
+ "step": 116
722
+ },
723
+ {
724
+ "epoch": 0.01,
725
+ "learning_rate": 4.999963622222803e-05,
726
+ "loss": 0.0364,
727
+ "step": 117
728
+ },
729
+ {
730
+ "epoch": 0.01,
731
+ "learning_rate": 4.9999592166216256e-05,
732
+ "loss": 0.0294,
733
+ "step": 118
734
+ },
735
+ {
736
+ "epoch": 0.01,
737
+ "learning_rate": 4.999954559274624e-05,
738
+ "loss": 0.0325,
739
+ "step": 119
740
+ },
741
+ {
742
+ "epoch": 0.01,
743
+ "learning_rate": 4.999949650182266e-05,
744
+ "loss": 0.0331,
745
+ "step": 120
746
+ },
747
+ {
748
+ "epoch": 0.01,
749
+ "learning_rate": 4.9999444893450476e-05,
750
+ "loss": 0.0894,
751
+ "step": 121
752
+ },
753
+ {
754
+ "epoch": 0.01,
755
+ "learning_rate": 4.999939076763487e-05,
756
+ "loss": 0.0324,
757
+ "step": 122
758
+ },
759
+ {
760
+ "epoch": 0.01,
761
+ "learning_rate": 4.99993341243813e-05,
762
+ "loss": 0.0245,
763
+ "step": 123
764
+ },
765
+ {
766
+ "epoch": 0.01,
767
+ "learning_rate": 4.999927496369547e-05,
768
+ "loss": 0.0187,
769
+ "step": 124
770
+ },
771
+ {
772
+ "epoch": 0.01,
773
+ "learning_rate": 4.999921328558333e-05,
774
+ "loss": 0.0201,
775
+ "step": 125
776
+ },
777
+ {
778
+ "epoch": 0.01,
779
+ "learning_rate": 4.99991490900511e-05,
780
+ "loss": 0.0199,
781
+ "step": 126
782
+ },
783
+ {
784
+ "epoch": 0.01,
785
+ "learning_rate": 4.999908237710523e-05,
786
+ "loss": 0.405,
787
+ "step": 127
788
+ },
789
+ {
790
+ "epoch": 0.01,
791
+ "learning_rate": 4.999901314675246e-05,
792
+ "loss": 0.6401,
793
+ "step": 128
794
+ },
795
+ {
796
+ "epoch": 0.01,
797
+ "learning_rate": 4.9998941398999754e-05,
798
+ "loss": 0.9999,
799
+ "step": 129
800
+ },
801
+ {
802
+ "epoch": 0.01,
803
+ "learning_rate": 4.999886713385432e-05,
804
+ "loss": 0.8034,
805
+ "step": 130
806
+ },
807
+ {
808
+ "epoch": 0.01,
809
+ "learning_rate": 4.999879035132366e-05,
810
+ "loss": 2.5507,
811
+ "step": 131
812
+ },
813
+ {
814
+ "epoch": 0.01,
815
+ "learning_rate": 4.999871105141549e-05,
816
+ "loss": 1.0299,
817
+ "step": 132
818
+ },
819
+ {
820
+ "epoch": 0.01,
821
+ "learning_rate": 4.999862923413781e-05,
822
+ "loss": 0.8507,
823
+ "step": 133
824
+ },
825
+ {
826
+ "epoch": 0.01,
827
+ "learning_rate": 4.999854489949884e-05,
828
+ "loss": 1.301,
829
+ "step": 134
830
+ },
831
+ {
832
+ "epoch": 0.01,
833
+ "learning_rate": 4.999845804750709e-05,
834
+ "loss": 0.9371,
835
+ "step": 135
836
+ },
837
+ {
838
+ "epoch": 0.01,
839
+ "learning_rate": 4.999836867817129e-05,
840
+ "loss": 1.071,
841
+ "step": 136
842
+ },
843
+ {
844
+ "epoch": 0.01,
845
+ "learning_rate": 4.999827679150045e-05,
846
+ "loss": 1.1755,
847
+ "step": 137
848
+ },
849
+ {
850
+ "epoch": 0.01,
851
+ "learning_rate": 4.999818238750382e-05,
852
+ "loss": 1.1019,
853
+ "step": 138
854
+ },
855
+ {
856
+ "epoch": 0.01,
857
+ "learning_rate": 4.999808546619091e-05,
858
+ "loss": 1.035,
859
+ "step": 139
860
+ },
861
+ {
862
+ "epoch": 0.01,
863
+ "learning_rate": 4.9997986027571485e-05,
864
+ "loss": 1.0751,
865
+ "step": 140
866
+ },
867
+ {
868
+ "epoch": 0.01,
869
+ "learning_rate": 4.9997884071655546e-05,
870
+ "loss": 0.9669,
871
+ "step": 141
872
+ },
873
+ {
874
+ "epoch": 0.01,
875
+ "learning_rate": 4.999777959845336e-05,
876
+ "loss": 1.619,
877
+ "step": 142
878
+ },
879
+ {
880
+ "epoch": 0.01,
881
+ "learning_rate": 4.999767260797546e-05,
882
+ "loss": 1.0327,
883
+ "step": 143
884
+ },
885
+ {
886
+ "epoch": 0.01,
887
+ "learning_rate": 4.999756310023261e-05,
888
+ "loss": 1.4227,
889
+ "step": 144
890
+ },
891
+ {
892
+ "epoch": 0.01,
893
+ "learning_rate": 4.9997451075235834e-05,
894
+ "loss": 1.1229,
895
+ "step": 145
896
+ },
897
+ {
898
+ "epoch": 0.01,
899
+ "learning_rate": 4.9997336532996426e-05,
900
+ "loss": 1.0647,
901
+ "step": 146
902
+ },
903
+ {
904
+ "epoch": 0.01,
905
+ "learning_rate": 4.999721947352591e-05,
906
+ "loss": 0.8365,
907
+ "step": 147
908
+ },
909
+ {
910
+ "epoch": 0.01,
911
+ "learning_rate": 4.999709989683607e-05,
912
+ "loss": 0.9427,
913
+ "step": 148
914
+ },
915
+ {
916
+ "epoch": 0.01,
917
+ "learning_rate": 4.999697780293897e-05,
918
+ "loss": 0.9069,
919
+ "step": 149
920
+ },
921
+ {
922
+ "epoch": 0.01,
923
+ "learning_rate": 4.9996853191846885e-05,
924
+ "loss": 0.4741,
925
+ "step": 150
926
+ },
927
+ {
928
+ "epoch": 0.01,
929
+ "eval_loss": 1.0061652660369873,
930
+ "eval_runtime": 33.3013,
931
+ "eval_samples_per_second": 2.552,
932
+ "eval_steps_per_second": 0.661,
933
+ "step": 150
934
+ },
935
+ {
936
+ "epoch": 0.02,
937
+ "learning_rate": 4.999672606357236e-05,
938
+ "loss": 1.1091,
939
+ "step": 151
940
+ },
941
+ {
942
+ "epoch": 0.02,
943
+ "learning_rate": 4.99965964181282e-05,
944
+ "loss": 1.045,
945
+ "step": 152
946
+ },
947
+ {
948
+ "epoch": 0.02,
949
+ "learning_rate": 4.9996464255527475e-05,
950
+ "loss": 1.2467,
951
+ "step": 153
952
+ },
953
+ {
954
+ "epoch": 0.02,
955
+ "learning_rate": 4.999632957578349e-05,
956
+ "loss": 1.2496,
957
+ "step": 154
958
+ },
959
+ {
960
+ "epoch": 0.02,
961
+ "learning_rate": 4.9996192378909786e-05,
962
+ "loss": 1.0957,
963
+ "step": 155
964
+ },
965
+ {
966
+ "epoch": 0.02,
967
+ "learning_rate": 4.9996052664920195e-05,
968
+ "loss": 2.7016,
969
+ "step": 156
970
+ },
971
+ {
972
+ "epoch": 0.02,
973
+ "learning_rate": 4.999591043382878e-05,
974
+ "loss": 0.9565,
975
+ "step": 157
976
+ },
977
+ {
978
+ "epoch": 0.02,
979
+ "learning_rate": 4.9995765685649885e-05,
980
+ "loss": 0.4296,
981
+ "step": 158
982
+ },
983
+ {
984
+ "epoch": 0.02,
985
+ "learning_rate": 4.999561842039806e-05,
986
+ "loss": 0.9448,
987
+ "step": 159
988
+ },
989
+ {
990
+ "epoch": 0.02,
991
+ "learning_rate": 4.999546863808815e-05,
992
+ "loss": 1.0846,
993
+ "step": 160
994
+ },
995
+ {
996
+ "epoch": 0.02,
997
+ "learning_rate": 4.999531633873522e-05,
998
+ "loss": 1.0365,
999
+ "step": 161
1000
+ },
1001
+ {
1002
+ "epoch": 0.02,
1003
+ "learning_rate": 4.9995161522354626e-05,
1004
+ "loss": 1.0785,
1005
+ "step": 162
1006
+ },
1007
+ {
1008
+ "epoch": 0.02,
1009
+ "learning_rate": 4.9995004188961954e-05,
1010
+ "loss": 1.0112,
1011
+ "step": 163
1012
+ },
1013
+ {
1014
+ "epoch": 0.02,
1015
+ "learning_rate": 4.9994844338573047e-05,
1016
+ "loss": 1.0194,
1017
+ "step": 164
1018
+ },
1019
+ {
1020
+ "epoch": 0.02,
1021
+ "learning_rate": 4.9994681971203985e-05,
1022
+ "loss": 1.1474,
1023
+ "step": 165
1024
+ },
1025
+ {
1026
+ "epoch": 0.02,
1027
+ "learning_rate": 4.999451708687114e-05,
1028
+ "loss": 1.0013,
1029
+ "step": 166
1030
+ },
1031
+ {
1032
+ "epoch": 0.02,
1033
+ "learning_rate": 4.999434968559111e-05,
1034
+ "loss": 1.2304,
1035
+ "step": 167
1036
+ },
1037
+ {
1038
+ "epoch": 0.02,
1039
+ "learning_rate": 4.9994179767380746e-05,
1040
+ "loss": 0.8919,
1041
+ "step": 168
1042
+ },
1043
+ {
1044
+ "epoch": 0.02,
1045
+ "learning_rate": 4.9994007332257166e-05,
1046
+ "loss": 1.0994,
1047
+ "step": 169
1048
+ },
1049
+ {
1050
+ "epoch": 0.02,
1051
+ "learning_rate": 4.9993832380237735e-05,
1052
+ "loss": 0.9525,
1053
+ "step": 170
1054
+ },
1055
+ {
1056
+ "epoch": 0.02,
1057
+ "learning_rate": 4.999365491134006e-05,
1058
+ "loss": 0.9128,
1059
+ "step": 171
1060
+ },
1061
+ {
1062
+ "epoch": 0.02,
1063
+ "learning_rate": 4.999347492558202e-05,
1064
+ "loss": 0.9752,
1065
+ "step": 172
1066
+ },
1067
+ {
1068
+ "epoch": 0.02,
1069
+ "learning_rate": 4.9993292422981744e-05,
1070
+ "loss": 1.0829,
1071
+ "step": 173
1072
+ },
1073
+ {
1074
+ "epoch": 0.02,
1075
+ "learning_rate": 4.9993107403557606e-05,
1076
+ "loss": 1.0873,
1077
+ "step": 174
1078
+ },
1079
+ {
1080
+ "epoch": 0.02,
1081
+ "learning_rate": 4.999291986732823e-05,
1082
+ "loss": 0.7728,
1083
+ "step": 175
1084
+ },
1085
+ {
1086
+ "epoch": 0.02,
1087
+ "learning_rate": 4.999272981431251e-05,
1088
+ "loss": 1.2234,
1089
+ "step": 176
1090
+ },
1091
+ {
1092
+ "epoch": 0.02,
1093
+ "learning_rate": 4.999253724452958e-05,
1094
+ "loss": 1.1018,
1095
+ "step": 177
1096
+ },
1097
+ {
1098
+ "epoch": 0.02,
1099
+ "learning_rate": 4.999234215799884e-05,
1100
+ "loss": 1.323,
1101
+ "step": 178
1102
+ },
1103
+ {
1104
+ "epoch": 0.02,
1105
+ "learning_rate": 4.9992144554739915e-05,
1106
+ "loss": 1.3506,
1107
+ "step": 179
1108
+ },
1109
+ {
1110
+ "epoch": 0.02,
1111
+ "learning_rate": 4.9991944434772734e-05,
1112
+ "loss": 0.9995,
1113
+ "step": 180
1114
+ },
1115
+ {
1116
+ "epoch": 0.02,
1117
+ "learning_rate": 4.999174179811742e-05,
1118
+ "loss": 1.0128,
1119
+ "step": 181
1120
+ },
1121
+ {
1122
+ "epoch": 0.02,
1123
+ "learning_rate": 4.9991536644794394e-05,
1124
+ "loss": 0.9663,
1125
+ "step": 182
1126
+ },
1127
+ {
1128
+ "epoch": 0.02,
1129
+ "learning_rate": 4.9991328974824314e-05,
1130
+ "loss": 0.9088,
1131
+ "step": 183
1132
+ },
1133
+ {
1134
+ "epoch": 0.02,
1135
+ "learning_rate": 4.9991118788228084e-05,
1136
+ "loss": 0.9769,
1137
+ "step": 184
1138
+ },
1139
+ {
1140
+ "epoch": 0.02,
1141
+ "learning_rate": 4.999090608502688e-05,
1142
+ "loss": 1.1041,
1143
+ "step": 185
1144
+ },
1145
+ {
1146
+ "epoch": 0.02,
1147
+ "learning_rate": 4.999069086524212e-05,
1148
+ "loss": 1.0777,
1149
+ "step": 186
1150
+ },
1151
+ {
1152
+ "epoch": 0.02,
1153
+ "learning_rate": 4.999047312889547e-05,
1154
+ "loss": 1.0644,
1155
+ "step": 187
1156
+ },
1157
+ {
1158
+ "epoch": 0.02,
1159
+ "learning_rate": 4.999025287600886e-05,
1160
+ "loss": 1.2527,
1161
+ "step": 188
1162
+ },
1163
+ {
1164
+ "epoch": 0.02,
1165
+ "learning_rate": 4.9990030106604466e-05,
1166
+ "loss": 1.1408,
1167
+ "step": 189
1168
+ },
1169
+ {
1170
+ "epoch": 0.02,
1171
+ "learning_rate": 4.9989804820704735e-05,
1172
+ "loss": 1.0382,
1173
+ "step": 190
1174
+ },
1175
+ {
1176
+ "epoch": 0.02,
1177
+ "learning_rate": 4.998957701833233e-05,
1178
+ "loss": 0.8821,
1179
+ "step": 191
1180
+ },
1181
+ {
1182
+ "epoch": 0.02,
1183
+ "learning_rate": 4.998934669951021e-05,
1184
+ "loss": 1.1115,
1185
+ "step": 192
1186
+ },
1187
+ {
1188
+ "epoch": 0.02,
1189
+ "learning_rate": 4.998911386426156e-05,
1190
+ "loss": 1.0668,
1191
+ "step": 193
1192
+ },
1193
+ {
1194
+ "epoch": 0.02,
1195
+ "learning_rate": 4.998887851260983e-05,
1196
+ "loss": 1.3347,
1197
+ "step": 194
1198
+ },
1199
+ {
1200
+ "epoch": 0.02,
1201
+ "learning_rate": 4.998864064457871e-05,
1202
+ "loss": 1.8449,
1203
+ "step": 195
1204
+ },
1205
+ {
1206
+ "epoch": 0.02,
1207
+ "learning_rate": 4.998840026019217e-05,
1208
+ "loss": 0.8444,
1209
+ "step": 196
1210
+ },
1211
+ {
1212
+ "epoch": 0.02,
1213
+ "learning_rate": 4.99881573594744e-05,
1214
+ "loss": 0.6749,
1215
+ "step": 197
1216
+ },
1217
+ {
1218
+ "epoch": 0.02,
1219
+ "learning_rate": 4.9987911942449874e-05,
1220
+ "loss": 0.8313,
1221
+ "step": 198
1222
+ },
1223
+ {
1224
+ "epoch": 0.02,
1225
+ "learning_rate": 4.998766400914329e-05,
1226
+ "loss": 1.1872,
1227
+ "step": 199
1228
+ },
1229
+ {
1230
+ "epoch": 0.02,
1231
+ "learning_rate": 4.9987413559579636e-05,
1232
+ "loss": 1.0037,
1233
+ "step": 200
1234
+ },
1235
+ {
1236
+ "epoch": 0.02,
1237
+ "eval_loss": 1.009230613708496,
1238
+ "eval_runtime": 34.1185,
1239
+ "eval_samples_per_second": 2.491,
1240
+ "eval_steps_per_second": 0.645,
1241
+ "step": 200
1242
+ },
1243
+ {
1244
+ "epoch": 0.02,
1245
+ "learning_rate": 4.998716059378411e-05,
1246
+ "loss": 0.9677,
1247
+ "step": 201
1248
+ },
1249
+ {
1250
+ "epoch": 0.02,
1251
+ "learning_rate": 4.99869051117822e-05,
1252
+ "loss": 0.7094,
1253
+ "step": 202
1254
+ },
1255
+ {
1256
+ "epoch": 0.02,
1257
+ "learning_rate": 4.998664711359963e-05,
1258
+ "loss": 0.9669,
1259
+ "step": 203
1260
+ },
1261
+ {
1262
+ "epoch": 0.02,
1263
+ "learning_rate": 4.9986386599262374e-05,
1264
+ "loss": 0.7753,
1265
+ "step": 204
1266
+ },
1267
+ {
1268
+ "epoch": 0.02,
1269
+ "learning_rate": 4.998612356879667e-05,
1270
+ "loss": 0.7886,
1271
+ "step": 205
1272
+ },
1273
+ {
1274
+ "epoch": 0.02,
1275
+ "learning_rate": 4.9985858022229015e-05,
1276
+ "loss": 1.0666,
1277
+ "step": 206
1278
+ },
1279
+ {
1280
+ "epoch": 0.02,
1281
+ "learning_rate": 4.998558995958614e-05,
1282
+ "loss": 1.0726,
1283
+ "step": 207
1284
+ },
1285
+ {
1286
+ "epoch": 0.02,
1287
+ "learning_rate": 4.998531938089503e-05,
1288
+ "loss": 0.6764,
1289
+ "step": 208
1290
+ },
1291
+ {
1292
+ "epoch": 0.02,
1293
+ "learning_rate": 4.998504628618296e-05,
1294
+ "loss": 0.9581,
1295
+ "step": 209
1296
+ },
1297
+ {
1298
+ "epoch": 0.02,
1299
+ "learning_rate": 4.99847706754774e-05,
1300
+ "loss": 0.8455,
1301
+ "step": 210
1302
+ },
1303
+ {
1304
+ "epoch": 0.02,
1305
+ "learning_rate": 4.998449254880612e-05,
1306
+ "loss": 1.0878,
1307
+ "step": 211
1308
+ },
1309
+ {
1310
+ "epoch": 0.02,
1311
+ "learning_rate": 4.998421190619711e-05,
1312
+ "loss": 1.0696,
1313
+ "step": 212
1314
+ },
1315
+ {
1316
+ "epoch": 0.02,
1317
+ "learning_rate": 4.9983928747678663e-05,
1318
+ "loss": 1.1857,
1319
+ "step": 213
1320
+ },
1321
+ {
1322
+ "epoch": 0.02,
1323
+ "learning_rate": 4.998364307327927e-05,
1324
+ "loss": 0.5613,
1325
+ "step": 214
1326
+ },
1327
+ {
1328
+ "epoch": 0.02,
1329
+ "learning_rate": 4.99833548830277e-05,
1330
+ "loss": 1.5976,
1331
+ "step": 215
1332
+ },
1333
+ {
1334
+ "epoch": 0.02,
1335
+ "learning_rate": 4.9983064176952976e-05,
1336
+ "loss": 1.304,
1337
+ "step": 216
1338
+ },
1339
+ {
1340
+ "epoch": 0.02,
1341
+ "learning_rate": 4.9982770955084376e-05,
1342
+ "loss": 1.1785,
1343
+ "step": 217
1344
+ },
1345
+ {
1346
+ "epoch": 0.02,
1347
+ "learning_rate": 4.9982475217451426e-05,
1348
+ "loss": 1.369,
1349
+ "step": 218
1350
+ },
1351
+ {
1352
+ "epoch": 0.02,
1353
+ "learning_rate": 4.998217696408391e-05,
1354
+ "loss": 1.3781,
1355
+ "step": 219
1356
+ },
1357
+ {
1358
+ "epoch": 0.02,
1359
+ "learning_rate": 4.9981876195011844e-05,
1360
+ "loss": 1.2481,
1361
+ "step": 220
1362
+ },
1363
+ {
1364
+ "epoch": 0.02,
1365
+ "learning_rate": 4.998157291026553e-05,
1366
+ "loss": 1.1869,
1367
+ "step": 221
1368
+ },
1369
+ {
1370
+ "epoch": 0.02,
1371
+ "learning_rate": 4.998126710987552e-05,
1372
+ "loss": 1.0437,
1373
+ "step": 222
1374
+ },
1375
+ {
1376
+ "epoch": 0.02,
1377
+ "learning_rate": 4.9980958793872577e-05,
1378
+ "loss": 1.0083,
1379
+ "step": 223
1380
+ },
1381
+ {
1382
+ "epoch": 0.02,
1383
+ "learning_rate": 4.998064796228779e-05,
1384
+ "loss": 0.8874,
1385
+ "step": 224
1386
+ },
1387
+ {
1388
+ "epoch": 0.02,
1389
+ "learning_rate": 4.998033461515242e-05,
1390
+ "loss": 1.0524,
1391
+ "step": 225
1392
+ },
1393
+ {
1394
+ "epoch": 0.02,
1395
+ "learning_rate": 4.9980018752498035e-05,
1396
+ "loss": 0.9784,
1397
+ "step": 226
1398
+ },
1399
+ {
1400
+ "epoch": 0.02,
1401
+ "learning_rate": 4.9979700374356455e-05,
1402
+ "loss": 0.8767,
1403
+ "step": 227
1404
+ },
1405
+ {
1406
+ "epoch": 0.02,
1407
+ "learning_rate": 4.997937948075973e-05,
1408
+ "loss": 1.0886,
1409
+ "step": 228
1410
+ },
1411
+ {
1412
+ "epoch": 0.02,
1413
+ "learning_rate": 4.997905607174017e-05,
1414
+ "loss": 0.8765,
1415
+ "step": 229
1416
+ },
1417
+ {
1418
+ "epoch": 0.02,
1419
+ "learning_rate": 4.9978730147330355e-05,
1420
+ "loss": 0.7674,
1421
+ "step": 230
1422
+ },
1423
+ {
1424
+ "epoch": 0.02,
1425
+ "learning_rate": 4.9978401707563096e-05,
1426
+ "loss": 0.9259,
1427
+ "step": 231
1428
+ },
1429
+ {
1430
+ "epoch": 0.02,
1431
+ "learning_rate": 4.997807075247146e-05,
1432
+ "loss": 0.9196,
1433
+ "step": 232
1434
+ },
1435
+ {
1436
+ "epoch": 0.02,
1437
+ "learning_rate": 4.997773728208879e-05,
1438
+ "loss": 1.0045,
1439
+ "step": 233
1440
+ },
1441
+ {
1442
+ "epoch": 0.02,
1443
+ "learning_rate": 4.997740129644865e-05,
1444
+ "loss": 0.5903,
1445
+ "step": 234
1446
+ },
1447
+ {
1448
+ "epoch": 0.02,
1449
+ "learning_rate": 4.9977062795584893e-05,
1450
+ "loss": 0.802,
1451
+ "step": 235
1452
+ },
1453
+ {
1454
+ "epoch": 0.02,
1455
+ "learning_rate": 4.99767217795316e-05,
1456
+ "loss": 0.7193,
1457
+ "step": 236
1458
+ },
1459
+ {
1460
+ "epoch": 0.02,
1461
+ "learning_rate": 4.9976378248323095e-05,
1462
+ "loss": 0.8271,
1463
+ "step": 237
1464
+ },
1465
+ {
1466
+ "epoch": 0.02,
1467
+ "learning_rate": 4.997603220199399e-05,
1468
+ "loss": 0.9451,
1469
+ "step": 238
1470
+ },
1471
+ {
1472
+ "epoch": 0.02,
1473
+ "learning_rate": 4.9975683640579126e-05,
1474
+ "loss": 0.7997,
1475
+ "step": 239
1476
+ },
1477
+ {
1478
+ "epoch": 0.02,
1479
+ "learning_rate": 4.99753325641136e-05,
1480
+ "loss": 0.9519,
1481
+ "step": 240
1482
+ },
1483
+ {
1484
+ "epoch": 0.02,
1485
+ "learning_rate": 4.997497897263277e-05,
1486
+ "loss": 1.0293,
1487
+ "step": 241
1488
+ },
1489
+ {
1490
+ "epoch": 0.02,
1491
+ "learning_rate": 4.997462286617224e-05,
1492
+ "loss": 0.5886,
1493
+ "step": 242
1494
+ },
1495
+ {
1496
+ "epoch": 0.02,
1497
+ "learning_rate": 4.997426424476787e-05,
1498
+ "loss": 0.9684,
1499
+ "step": 243
1500
+ },
1501
+ {
1502
+ "epoch": 0.02,
1503
+ "learning_rate": 4.997390310845578e-05,
1504
+ "loss": 0.9717,
1505
+ "step": 244
1506
+ },
1507
+ {
1508
+ "epoch": 0.02,
1509
+ "learning_rate": 4.997353945727232e-05,
1510
+ "loss": 0.6933,
1511
+ "step": 245
1512
+ },
1513
+ {
1514
+ "epoch": 0.02,
1515
+ "learning_rate": 4.9973173291254126e-05,
1516
+ "loss": 0.6983,
1517
+ "step": 246
1518
+ },
1519
+ {
1520
+ "epoch": 0.02,
1521
+ "learning_rate": 4.997280461043806e-05,
1522
+ "loss": 0.7808,
1523
+ "step": 247
1524
+ },
1525
+ {
1526
+ "epoch": 0.02,
1527
+ "learning_rate": 4.997243341486127e-05,
1528
+ "loss": 1.0136,
1529
+ "step": 248
1530
+ },
1531
+ {
1532
+ "epoch": 0.02,
1533
+ "learning_rate": 4.9972059704561094e-05,
1534
+ "loss": 0.8564,
1535
+ "step": 249
1536
+ },
1537
+ {
1538
+ "epoch": 0.03,
1539
+ "learning_rate": 4.99716834795752e-05,
1540
+ "loss": 0.9686,
1541
+ "step": 250
1542
+ },
1543
+ {
1544
+ "epoch": 0.03,
1545
+ "eval_loss": 0.9817100167274475,
1546
+ "eval_runtime": 34.0668,
1547
+ "eval_samples_per_second": 2.495,
1548
+ "eval_steps_per_second": 0.646,
1549
+ "step": 250
1550
+ },
1551
+ {
1552
+ "epoch": 0.03,
1553
+ "learning_rate": 4.9971304739941465e-05,
1554
+ "loss": 0.9119,
1555
+ "step": 251
1556
+ },
1557
+ {
1558
+ "epoch": 0.03,
1559
+ "learning_rate": 4.9970923485698025e-05,
1560
+ "loss": 0.751,
1561
+ "step": 252
1562
+ },
1563
+ {
1564
+ "epoch": 0.03,
1565
+ "learning_rate": 4.997053971688327e-05,
1566
+ "loss": 0.7892,
1567
+ "step": 253
1568
+ },
1569
+ {
1570
+ "epoch": 0.03,
1571
+ "learning_rate": 4.997015343353585e-05,
1572
+ "loss": 0.9822,
1573
+ "step": 254
1574
+ },
1575
+ {
1576
+ "epoch": 0.03,
1577
+ "learning_rate": 4.996976463569467e-05,
1578
+ "loss": 1.0816,
1579
+ "step": 255
1580
+ },
1581
+ {
1582
+ "epoch": 0.03,
1583
+ "learning_rate": 4.996937332339887e-05,
1584
+ "loss": 1.1014,
1585
+ "step": 256
1586
+ },
1587
+ {
1588
+ "epoch": 0.03,
1589
+ "learning_rate": 4.996897949668785e-05,
1590
+ "loss": 0.4182,
1591
+ "step": 257
1592
+ },
1593
+ {
1594
+ "epoch": 0.03,
1595
+ "learning_rate": 4.996858315560129e-05,
1596
+ "loss": 0.7549,
1597
+ "step": 258
1598
+ },
1599
+ {
1600
+ "epoch": 0.03,
1601
+ "learning_rate": 4.996818430017908e-05,
1602
+ "loss": 0.9744,
1603
+ "step": 259
1604
+ },
1605
+ {
1606
+ "epoch": 0.03,
1607
+ "learning_rate": 4.996778293046141e-05,
1608
+ "loss": 0.7919,
1609
+ "step": 260
1610
+ },
1611
+ {
1612
+ "epoch": 0.03,
1613
+ "learning_rate": 4.996737904648866e-05,
1614
+ "loss": 1.8199,
1615
+ "step": 261
1616
+ },
1617
+ {
1618
+ "epoch": 0.03,
1619
+ "learning_rate": 4.9966972648301536e-05,
1620
+ "loss": 0.8733,
1621
+ "step": 262
1622
+ },
1623
+ {
1624
+ "epoch": 0.03,
1625
+ "learning_rate": 4.996656373594095e-05,
1626
+ "loss": 0.6261,
1627
+ "step": 263
1628
+ },
1629
+ {
1630
+ "epoch": 0.03,
1631
+ "learning_rate": 4.9966152309448076e-05,
1632
+ "loss": 0.0999,
1633
+ "step": 264
1634
+ },
1635
+ {
1636
+ "epoch": 0.03,
1637
+ "learning_rate": 4.996573836886435e-05,
1638
+ "loss": 0.0401,
1639
+ "step": 265
1640
+ },
1641
+ {
1642
+ "epoch": 0.03,
1643
+ "learning_rate": 4.996532191423145e-05,
1644
+ "loss": 0.0413,
1645
+ "step": 266
1646
+ },
1647
+ {
1648
+ "epoch": 0.03,
1649
+ "learning_rate": 4.996490294559132e-05,
1650
+ "loss": 0.0241,
1651
+ "step": 267
1652
+ },
1653
+ {
1654
+ "epoch": 0.03,
1655
+ "learning_rate": 4.996448146298614e-05,
1656
+ "loss": 0.0184,
1657
+ "step": 268
1658
+ },
1659
+ {
1660
+ "epoch": 0.03,
1661
+ "learning_rate": 4.996405746645837e-05,
1662
+ "loss": 0.0239,
1663
+ "step": 269
1664
+ },
1665
+ {
1666
+ "epoch": 0.03,
1667
+ "learning_rate": 4.996363095605069e-05,
1668
+ "loss": 0.0208,
1669
+ "step": 270
1670
+ },
1671
+ {
1672
+ "epoch": 0.03,
1673
+ "learning_rate": 4.996320193180606e-05,
1674
+ "loss": 0.0184,
1675
+ "step": 271
1676
+ },
1677
+ {
1678
+ "epoch": 0.03,
1679
+ "learning_rate": 4.996277039376767e-05,
1680
+ "loss": 0.0259,
1681
+ "step": 272
1682
+ },
1683
+ {
1684
+ "epoch": 0.03,
1685
+ "learning_rate": 4.996233634197899e-05,
1686
+ "loss": 0.0215,
1687
+ "step": 273
1688
+ },
1689
+ {
1690
+ "epoch": 0.03,
1691
+ "learning_rate": 4.996189977648372e-05,
1692
+ "loss": 0.023,
1693
+ "step": 274
1694
+ },
1695
+ {
1696
+ "epoch": 0.03,
1697
+ "learning_rate": 4.996146069732583e-05,
1698
+ "loss": 0.0657,
1699
+ "step": 275
1700
+ },
1701
+ {
1702
+ "epoch": 0.03,
1703
+ "learning_rate": 4.996101910454953e-05,
1704
+ "loss": 0.0218,
1705
+ "step": 276
1706
+ },
1707
+ {
1708
+ "epoch": 0.03,
1709
+ "learning_rate": 4.9960574998199285e-05,
1710
+ "loss": 0.0164,
1711
+ "step": 277
1712
+ },
1713
+ {
1714
+ "epoch": 0.03,
1715
+ "learning_rate": 4.9960128378319825e-05,
1716
+ "loss": 0.0219,
1717
+ "step": 278
1718
+ },
1719
+ {
1720
+ "epoch": 0.03,
1721
+ "learning_rate": 4.995967924495611e-05,
1722
+ "loss": 0.0198,
1723
+ "step": 279
1724
+ },
1725
+ {
1726
+ "epoch": 0.03,
1727
+ "learning_rate": 4.995922759815339e-05,
1728
+ "loss": 0.0133,
1729
+ "step": 280
1730
+ },
1731
+ {
1732
+ "epoch": 0.03,
1733
+ "learning_rate": 4.995877343795714e-05,
1734
+ "loss": 0.15,
1735
+ "step": 281
1736
+ },
1737
+ {
1738
+ "epoch": 0.03,
1739
+ "learning_rate": 4.995831676441307e-05,
1740
+ "loss": 0.5379,
1741
+ "step": 282
1742
+ },
1743
+ {
1744
+ "epoch": 0.03,
1745
+ "learning_rate": 4.9957857577567197e-05,
1746
+ "loss": 0.8015,
1747
+ "step": 283
1748
+ },
1749
+ {
1750
+ "epoch": 0.03,
1751
+ "learning_rate": 4.995739587746574e-05,
1752
+ "loss": 0.854,
1753
+ "step": 284
1754
+ },
1755
+ {
1756
+ "epoch": 0.03,
1757
+ "learning_rate": 4.995693166415521e-05,
1758
+ "loss": 0.7475,
1759
+ "step": 285
1760
+ },
1761
+ {
1762
+ "epoch": 0.03,
1763
+ "learning_rate": 4.995646493768234e-05,
1764
+ "loss": 0.9936,
1765
+ "step": 286
1766
+ },
1767
+ {
1768
+ "epoch": 0.03,
1769
+ "learning_rate": 4.995599569809414e-05,
1770
+ "loss": 0.3887,
1771
+ "step": 287
1772
+ },
1773
+ {
1774
+ "epoch": 0.03,
1775
+ "learning_rate": 4.995552394543784e-05,
1776
+ "loss": 2.4369,
1777
+ "step": 288
1778
+ },
1779
+ {
1780
+ "epoch": 0.03,
1781
+ "learning_rate": 4.995504967976098e-05,
1782
+ "loss": 0.8289,
1783
+ "step": 289
1784
+ },
1785
+ {
1786
+ "epoch": 0.03,
1787
+ "learning_rate": 4.9954572901111286e-05,
1788
+ "loss": 1.0428,
1789
+ "step": 290
1790
+ },
1791
+ {
1792
+ "epoch": 0.03,
1793
+ "learning_rate": 4.995409360953679e-05,
1794
+ "loss": 1.1485,
1795
+ "step": 291
1796
+ },
1797
+ {
1798
+ "epoch": 0.03,
1799
+ "learning_rate": 4.995361180508575e-05,
1800
+ "loss": 1.3428,
1801
+ "step": 292
1802
+ },
1803
+ {
1804
+ "epoch": 0.03,
1805
+ "learning_rate": 4.995312748780668e-05,
1806
+ "loss": 1.0792,
1807
+ "step": 293
1808
+ },
1809
+ {
1810
+ "epoch": 0.03,
1811
+ "learning_rate": 4.995264065774836e-05,
1812
+ "loss": 1.1226,
1813
+ "step": 294
1814
+ },
1815
+ {
1816
+ "epoch": 0.03,
1817
+ "learning_rate": 4.995215131495981e-05,
1818
+ "loss": 1.0069,
1819
+ "step": 295
1820
+ },
1821
+ {
1822
+ "epoch": 0.03,
1823
+ "learning_rate": 4.9951659459490294e-05,
1824
+ "loss": 0.883,
1825
+ "step": 296
1826
+ },
1827
+ {
1828
+ "epoch": 0.03,
1829
+ "learning_rate": 4.995116509138936e-05,
1830
+ "loss": 1.2333,
1831
+ "step": 297
1832
+ },
1833
+ {
1834
+ "epoch": 0.03,
1835
+ "learning_rate": 4.995066821070679e-05,
1836
+ "loss": 0.9823,
1837
+ "step": 298
1838
+ },
1839
+ {
1840
+ "epoch": 0.03,
1841
+ "learning_rate": 4.995016881749261e-05,
1842
+ "loss": 0.5749,
1843
+ "step": 299
1844
+ },
1845
+ {
1846
+ "epoch": 0.03,
1847
+ "learning_rate": 4.994966691179711e-05,
1848
+ "loss": 0.9226,
1849
+ "step": 300
1850
+ },
1851
+ {
1852
+ "epoch": 0.03,
1853
+ "eval_loss": 0.9751874804496765,
1854
+ "eval_runtime": 32.4269,
1855
+ "eval_samples_per_second": 2.621,
1856
+ "eval_steps_per_second": 0.678,
1857
+ "step": 300
1858
+ },
1859
+ {
1860
+ "epoch": 0.03,
1861
+ "learning_rate": 4.994916249367084e-05,
1862
+ "loss": 2.3283,
1863
+ "step": 301
1864
+ },
1865
+ {
1866
+ "epoch": 0.03,
1867
+ "learning_rate": 4.994865556316458e-05,
1868
+ "loss": 1.2055,
1869
+ "step": 302
1870
+ },
1871
+ {
1872
+ "epoch": 0.03,
1873
+ "learning_rate": 4.9948146120329395e-05,
1874
+ "loss": 1.1512,
1875
+ "step": 303
1876
+ },
1877
+ {
1878
+ "epoch": 0.03,
1879
+ "learning_rate": 4.9947634165216584e-05,
1880
+ "loss": 1.1801,
1881
+ "step": 304
1882
+ },
1883
+ {
1884
+ "epoch": 0.03,
1885
+ "learning_rate": 4.994711969787769e-05,
1886
+ "loss": 1.1417,
1887
+ "step": 305
1888
+ },
1889
+ {
1890
+ "epoch": 0.03,
1891
+ "learning_rate": 4.9946602718364515e-05,
1892
+ "loss": 1.188,
1893
+ "step": 306
1894
+ },
1895
+ {
1896
+ "epoch": 0.03,
1897
+ "learning_rate": 4.994608322672914e-05,
1898
+ "loss": 1.1506,
1899
+ "step": 307
1900
+ },
1901
+ {
1902
+ "epoch": 0.03,
1903
+ "learning_rate": 4.994556122302386e-05,
1904
+ "loss": 1.0243,
1905
+ "step": 308
1906
+ },
1907
+ {
1908
+ "epoch": 0.03,
1909
+ "learning_rate": 4.994503670730125e-05,
1910
+ "loss": 0.9896,
1911
+ "step": 309
1912
+ },
1913
+ {
1914
+ "epoch": 0.03,
1915
+ "learning_rate": 4.994450967961413e-05,
1916
+ "loss": 0.9248,
1917
+ "step": 310
1918
+ },
1919
+ {
1920
+ "epoch": 0.03,
1921
+ "learning_rate": 4.994398014001557e-05,
1922
+ "loss": 0.9892,
1923
+ "step": 311
1924
+ },
1925
+ {
1926
+ "epoch": 0.03,
1927
+ "learning_rate": 4.994344808855888e-05,
1928
+ "loss": 1.2689,
1929
+ "step": 312
1930
+ },
1931
+ {
1932
+ "epoch": 0.03,
1933
+ "learning_rate": 4.9942913525297655e-05,
1934
+ "loss": 0.49,
1935
+ "step": 313
1936
+ },
1937
+ {
1938
+ "epoch": 0.03,
1939
+ "learning_rate": 4.994237645028572e-05,
1940
+ "loss": 0.981,
1941
+ "step": 314
1942
+ },
1943
+ {
1944
+ "epoch": 0.03,
1945
+ "learning_rate": 4.994183686357717e-05,
1946
+ "loss": 0.6652,
1947
+ "step": 315
1948
+ },
1949
+ {
1950
+ "epoch": 0.03,
1951
+ "learning_rate": 4.994129476522632e-05,
1952
+ "loss": 1.0202,
1953
+ "step": 316
1954
+ },
1955
+ {
1956
+ "epoch": 0.03,
1957
+ "learning_rate": 4.9940750155287775e-05,
1958
+ "loss": 0.907,
1959
+ "step": 317
1960
+ },
1961
+ {
1962
+ "epoch": 0.03,
1963
+ "learning_rate": 4.994020303381636e-05,
1964
+ "loss": 0.982,
1965
+ "step": 318
1966
+ },
1967
+ {
1968
+ "epoch": 0.03,
1969
+ "learning_rate": 4.993965340086719e-05,
1970
+ "loss": 0.9564,
1971
+ "step": 319
1972
+ },
1973
+ {
1974
+ "epoch": 0.03,
1975
+ "learning_rate": 4.993910125649561e-05,
1976
+ "loss": 0.9261,
1977
+ "step": 320
1978
+ },
1979
+ {
1980
+ "epoch": 0.03,
1981
+ "learning_rate": 4.9938546600757205e-05,
1982
+ "loss": 0.973,
1983
+ "step": 321
1984
+ },
1985
+ {
1986
+ "epoch": 0.03,
1987
+ "learning_rate": 4.993798943370785e-05,
1988
+ "loss": 0.8215,
1989
+ "step": 322
1990
+ },
1991
+ {
1992
+ "epoch": 0.03,
1993
+ "learning_rate": 4.9937429755403634e-05,
1994
+ "loss": 0.5894,
1995
+ "step": 323
1996
+ },
1997
+ {
1998
+ "epoch": 0.03,
1999
+ "learning_rate": 4.993686756590093e-05,
2000
+ "loss": 1.0626,
2001
+ "step": 324
2002
+ },
2003
+ {
2004
+ "epoch": 0.03,
2005
+ "learning_rate": 4.993630286525634e-05,
2006
+ "loss": 1.1192,
2007
+ "step": 325
2008
+ },
2009
+ {
2010
+ "epoch": 0.03,
2011
+ "learning_rate": 4.993573565352674e-05,
2012
+ "loss": 1.1525,
2013
+ "step": 326
2014
+ },
2015
+ {
2016
+ "epoch": 0.03,
2017
+ "learning_rate": 4.9935165930769235e-05,
2018
+ "loss": 1.7204,
2019
+ "step": 327
2020
+ },
2021
+ {
2022
+ "epoch": 0.03,
2023
+ "learning_rate": 4.99345936970412e-05,
2024
+ "loss": 0.7658,
2025
+ "step": 328
2026
+ },
2027
+ {
2028
+ "epoch": 0.03,
2029
+ "learning_rate": 4.993401895240027e-05,
2030
+ "loss": 0.88,
2031
+ "step": 329
2032
+ },
2033
+ {
2034
+ "epoch": 0.03,
2035
+ "learning_rate": 4.993344169690431e-05,
2036
+ "loss": 0.7782,
2037
+ "step": 330
2038
+ },
2039
+ {
2040
+ "epoch": 0.03,
2041
+ "learning_rate": 4.9932861930611454e-05,
2042
+ "loss": 0.9215,
2043
+ "step": 331
2044
+ },
2045
+ {
2046
+ "epoch": 0.03,
2047
+ "learning_rate": 4.993227965358008e-05,
2048
+ "loss": 1.0628,
2049
+ "step": 332
2050
+ },
2051
+ {
2052
+ "epoch": 0.03,
2053
+ "learning_rate": 4.993169486586884e-05,
2054
+ "loss": 1.1187,
2055
+ "step": 333
2056
+ },
2057
+ {
2058
+ "epoch": 0.03,
2059
+ "learning_rate": 4.99311075675366e-05,
2060
+ "loss": 0.78,
2061
+ "step": 334
2062
+ },
2063
+ {
2064
+ "epoch": 0.03,
2065
+ "learning_rate": 4.9930517758642503e-05,
2066
+ "loss": 0.8167,
2067
+ "step": 335
2068
+ },
2069
+ {
2070
+ "epoch": 0.03,
2071
+ "learning_rate": 4.992992543924596e-05,
2072
+ "loss": 0.9075,
2073
+ "step": 336
2074
+ },
2075
+ {
2076
+ "epoch": 0.03,
2077
+ "learning_rate": 4.992933060940661e-05,
2078
+ "loss": 0.9998,
2079
+ "step": 337
2080
+ },
2081
+ {
2082
+ "epoch": 0.03,
2083
+ "learning_rate": 4.992873326918434e-05,
2084
+ "loss": 0.7426,
2085
+ "step": 338
2086
+ },
2087
+ {
2088
+ "epoch": 0.03,
2089
+ "learning_rate": 4.9928133418639316e-05,
2090
+ "loss": 0.8207,
2091
+ "step": 339
2092
+ },
2093
+ {
2094
+ "epoch": 0.03,
2095
+ "learning_rate": 4.992753105783194e-05,
2096
+ "loss": 0.0484,
2097
+ "step": 340
2098
+ },
2099
+ {
2100
+ "epoch": 0.03,
2101
+ "learning_rate": 4.992692618682286e-05,
2102
+ "loss": 0.0342,
2103
+ "step": 341
2104
+ },
2105
+ {
2106
+ "epoch": 0.03,
2107
+ "learning_rate": 4.992631880567301e-05,
2108
+ "loss": 0.0312,
2109
+ "step": 342
2110
+ },
2111
+ {
2112
+ "epoch": 0.03,
2113
+ "learning_rate": 4.9925708914443526e-05,
2114
+ "loss": 0.0224,
2115
+ "step": 343
2116
+ },
2117
+ {
2118
+ "epoch": 0.03,
2119
+ "learning_rate": 4.9925096513195846e-05,
2120
+ "loss": 0.0133,
2121
+ "step": 344
2122
+ },
2123
+ {
2124
+ "epoch": 0.03,
2125
+ "learning_rate": 4.992448160199162e-05,
2126
+ "loss": 0.0196,
2127
+ "step": 345
2128
+ },
2129
+ {
2130
+ "epoch": 0.03,
2131
+ "learning_rate": 4.992386418089279e-05,
2132
+ "loss": 0.0149,
2133
+ "step": 346
2134
+ },
2135
+ {
2136
+ "epoch": 0.03,
2137
+ "learning_rate": 4.992324424996151e-05,
2138
+ "loss": 0.0183,
2139
+ "step": 347
2140
+ },
2141
+ {
2142
+ "epoch": 0.03,
2143
+ "learning_rate": 4.992262180926022e-05,
2144
+ "loss": 0.0169,
2145
+ "step": 348
2146
+ },
2147
+ {
2148
+ "epoch": 0.03,
2149
+ "learning_rate": 4.992199685885159e-05,
2150
+ "loss": 0.023,
2151
+ "step": 349
2152
+ },
2153
+ {
2154
+ "epoch": 0.04,
2155
+ "learning_rate": 4.992136939879856e-05,
2156
+ "loss": 0.0146,
2157
+ "step": 350
2158
+ },
2159
+ {
2160
+ "epoch": 0.04,
2161
+ "eval_loss": 0.9827541708946228,
2162
+ "eval_runtime": 19.9161,
2163
+ "eval_samples_per_second": 4.268,
2164
+ "eval_steps_per_second": 1.105,
2165
+ "step": 350
2166
+ },
2167
+ {
2168
+ "epoch": 0.04,
2169
+ "learning_rate": 4.992073942916432e-05,
2170
+ "loss": 0.0515,
2171
+ "step": 351
2172
+ },
2173
+ {
2174
+ "epoch": 0.04,
2175
+ "learning_rate": 4.992010695001229e-05,
2176
+ "loss": 0.0209,
2177
+ "step": 352
2178
+ },
2179
+ {
2180
+ "epoch": 0.04,
2181
+ "learning_rate": 4.991947196140618e-05,
2182
+ "loss": 0.0136,
2183
+ "step": 353
2184
+ },
2185
+ {
2186
+ "epoch": 0.04,
2187
+ "learning_rate": 4.991883446340992e-05,
2188
+ "loss": 0.0157,
2189
+ "step": 354
2190
+ },
2191
+ {
2192
+ "epoch": 0.04,
2193
+ "learning_rate": 4.991819445608772e-05,
2194
+ "loss": 0.0119,
2195
+ "step": 355
2196
+ },
2197
+ {
2198
+ "epoch": 0.04,
2199
+ "learning_rate": 4.991755193950401e-05,
2200
+ "loss": 0.0135,
2201
+ "step": 356
2202
+ },
2203
+ {
2204
+ "epoch": 0.04,
2205
+ "learning_rate": 4.991690691372352e-05,
2206
+ "loss": 0.2149,
2207
+ "step": 357
2208
+ },
2209
+ {
2210
+ "epoch": 0.04,
2211
+ "learning_rate": 4.991625937881116e-05,
2212
+ "loss": 0.581,
2213
+ "step": 358
2214
+ },
2215
+ {
2216
+ "epoch": 0.04,
2217
+ "learning_rate": 4.991560933483218e-05,
2218
+ "loss": 0.86,
2219
+ "step": 359
2220
+ },
2221
+ {
2222
+ "epoch": 0.04,
2223
+ "learning_rate": 4.991495678185202e-05,
2224
+ "loss": 0.7326,
2225
+ "step": 360
2226
+ },
2227
+ {
2228
+ "epoch": 0.04,
2229
+ "learning_rate": 4.9914301719936386e-05,
2230
+ "loss": 2.0773,
2231
+ "step": 361
2232
+ },
2233
+ {
2234
+ "epoch": 0.04,
2235
+ "learning_rate": 4.9913644149151256e-05,
2236
+ "loss": 1.2954,
2237
+ "step": 362
2238
+ },
2239
+ {
2240
+ "epoch": 0.04,
2241
+ "learning_rate": 4.991298406956284e-05,
2242
+ "loss": 0.8239,
2243
+ "step": 363
2244
+ },
2245
+ {
2246
+ "epoch": 0.04,
2247
+ "learning_rate": 4.991232148123761e-05,
2248
+ "loss": 1.0969,
2249
+ "step": 364
2250
+ },
2251
+ {
2252
+ "epoch": 0.04,
2253
+ "learning_rate": 4.991165638424229e-05,
2254
+ "loss": 1.048,
2255
+ "step": 365
2256
+ },
2257
+ {
2258
+ "epoch": 0.04,
2259
+ "learning_rate": 4.991098877864385e-05,
2260
+ "loss": 0.8565,
2261
+ "step": 366
2262
+ },
2263
+ {
2264
+ "epoch": 0.04,
2265
+ "learning_rate": 4.991031866450953e-05,
2266
+ "loss": 1.1061,
2267
+ "step": 367
2268
+ },
2269
+ {
2270
+ "epoch": 0.04,
2271
+ "learning_rate": 4.990964604190679e-05,
2272
+ "loss": 0.9706,
2273
+ "step": 368
2274
+ },
2275
+ {
2276
+ "epoch": 0.04,
2277
+ "learning_rate": 4.990897091090338e-05,
2278
+ "loss": 1.019,
2279
+ "step": 369
2280
+ },
2281
+ {
2282
+ "epoch": 0.04,
2283
+ "learning_rate": 4.9908293271567286e-05,
2284
+ "loss": 0.9736,
2285
+ "step": 370
2286
+ },
2287
+ {
2288
+ "epoch": 0.04,
2289
+ "learning_rate": 4.990761312396673e-05,
2290
+ "loss": 0.8045,
2291
+ "step": 371
2292
+ },
2293
+ {
2294
+ "epoch": 0.04,
2295
+ "learning_rate": 4.990693046817023e-05,
2296
+ "loss": 1.4812,
2297
+ "step": 372
2298
+ },
2299
+ {
2300
+ "epoch": 0.04,
2301
+ "learning_rate": 4.99062453042465e-05,
2302
+ "loss": 1.0545,
2303
+ "step": 373
2304
+ },
2305
+ {
2306
+ "epoch": 0.04,
2307
+ "learning_rate": 4.990555763226455e-05,
2308
+ "loss": 1.3077,
2309
+ "step": 374
2310
+ },
2311
+ {
2312
+ "epoch": 0.04,
2313
+ "learning_rate": 4.990486745229364e-05,
2314
+ "loss": 1.0062,
2315
+ "step": 375
2316
+ },
2317
+ {
2318
+ "epoch": 0.04,
2319
+ "learning_rate": 4.9904174764403255e-05,
2320
+ "loss": 0.9672,
2321
+ "step": 376
2322
+ },
2323
+ {
2324
+ "epoch": 0.04,
2325
+ "learning_rate": 4.990347956866315e-05,
2326
+ "loss": 0.7185,
2327
+ "step": 377
2328
+ },
2329
+ {
2330
+ "epoch": 0.04,
2331
+ "learning_rate": 4.9902781865143326e-05,
2332
+ "loss": 0.7711,
2333
+ "step": 378
2334
+ },
2335
+ {
2336
+ "epoch": 0.04,
2337
+ "learning_rate": 4.9902081653914056e-05,
2338
+ "loss": 0.9329,
2339
+ "step": 379
2340
+ },
2341
+ {
2342
+ "epoch": 0.04,
2343
+ "learning_rate": 4.990137893504585e-05,
2344
+ "loss": 0.3937,
2345
+ "step": 380
2346
+ },
2347
+ {
2348
+ "epoch": 0.04,
2349
+ "learning_rate": 4.9900673708609455e-05,
2350
+ "loss": 0.8259,
2351
+ "step": 381
2352
+ },
2353
+ {
2354
+ "epoch": 0.04,
2355
+ "learning_rate": 4.989996597467591e-05,
2356
+ "loss": 1.0272,
2357
+ "step": 382
2358
+ },
2359
+ {
2360
+ "epoch": 0.04,
2361
+ "learning_rate": 4.9899255733316465e-05,
2362
+ "loss": 0.9096,
2363
+ "step": 383
2364
+ },
2365
+ {
2366
+ "epoch": 0.04,
2367
+ "learning_rate": 4.9898542984602656e-05,
2368
+ "loss": 1.2616,
2369
+ "step": 384
2370
+ },
2371
+ {
2372
+ "epoch": 0.04,
2373
+ "learning_rate": 4.989782772860624e-05,
2374
+ "loss": 1.1187,
2375
+ "step": 385
2376
+ },
2377
+ {
2378
+ "epoch": 0.04,
2379
+ "learning_rate": 4.989710996539926e-05,
2380
+ "loss": 2.5803,
2381
+ "step": 386
2382
+ },
2383
+ {
2384
+ "epoch": 0.04,
2385
+ "learning_rate": 4.989638969505399e-05,
2386
+ "loss": 0.8739,
2387
+ "step": 387
2388
+ },
2389
+ {
2390
+ "epoch": 0.04,
2391
+ "learning_rate": 4.989566691764295e-05,
2392
+ "loss": 0.4262,
2393
+ "step": 388
2394
+ },
2395
+ {
2396
+ "epoch": 0.04,
2397
+ "learning_rate": 4.989494163323894e-05,
2398
+ "loss": 0.7617,
2399
+ "step": 389
2400
+ },
2401
+ {
2402
+ "epoch": 0.04,
2403
+ "learning_rate": 4.989421384191499e-05,
2404
+ "loss": 0.9713,
2405
+ "step": 390
2406
+ },
2407
+ {
2408
+ "epoch": 0.04,
2409
+ "learning_rate": 4.989348354374438e-05,
2410
+ "loss": 0.7856,
2411
+ "step": 391
2412
+ },
2413
+ {
2414
+ "epoch": 0.04,
2415
+ "learning_rate": 4.9892750738800664e-05,
2416
+ "loss": 1.0108,
2417
+ "step": 392
2418
+ },
2419
+ {
2420
+ "epoch": 0.04,
2421
+ "learning_rate": 4.989201542715762e-05,
2422
+ "loss": 0.8895,
2423
+ "step": 393
2424
+ },
2425
+ {
2426
+ "epoch": 0.04,
2427
+ "learning_rate": 4.989127760888932e-05,
2428
+ "loss": 0.8445,
2429
+ "step": 394
2430
+ },
2431
+ {
2432
+ "epoch": 0.04,
2433
+ "learning_rate": 4.9890537284070037e-05,
2434
+ "loss": 1.1767,
2435
+ "step": 395
2436
+ },
2437
+ {
2438
+ "epoch": 0.04,
2439
+ "learning_rate": 4.988979445277433e-05,
2440
+ "loss": 0.8743,
2441
+ "step": 396
2442
+ },
2443
+ {
2444
+ "epoch": 0.04,
2445
+ "learning_rate": 4.9889049115077005e-05,
2446
+ "loss": 1.0314,
2447
+ "step": 397
2448
+ },
2449
+ {
2450
+ "epoch": 0.04,
2451
+ "learning_rate": 4.988830127105311e-05,
2452
+ "loss": 0.8971,
2453
+ "step": 398
2454
+ },
2455
+ {
2456
+ "epoch": 0.04,
2457
+ "learning_rate": 4.9887550920777956e-05,
2458
+ "loss": 1.0006,
2459
+ "step": 399
2460
+ },
2461
+ {
2462
+ "epoch": 0.04,
2463
+ "learning_rate": 4.988679806432712e-05,
2464
+ "loss": 0.8815,
2465
+ "step": 400
2466
+ },
2467
+ {
2468
+ "epoch": 0.04,
2469
+ "eval_loss": 0.9530295729637146,
2470
+ "eval_runtime": 19.0653,
2471
+ "eval_samples_per_second": 4.458,
2472
+ "eval_steps_per_second": 1.154,
2473
+ "step": 400
2474
+ },
2475
+ {
2476
+ "epoch": 0.04,
2477
+ "learning_rate": 4.988604270177639e-05,
2478
+ "loss": 0.9408,
2479
+ "step": 401
2480
+ },
2481
+ {
2482
+ "epoch": 0.04,
2483
+ "learning_rate": 4.988528483320184e-05,
2484
+ "loss": 0.8568,
2485
+ "step": 402
2486
+ },
2487
+ {
2488
+ "epoch": 0.04,
2489
+ "learning_rate": 4.988452445867979e-05,
2490
+ "loss": 0.9129,
2491
+ "step": 403
2492
+ },
2493
+ {
2494
+ "epoch": 0.04,
2495
+ "learning_rate": 4.98837615782868e-05,
2496
+ "loss": 1.0926,
2497
+ "step": 404
2498
+ },
2499
+ {
2500
+ "epoch": 0.04,
2501
+ "learning_rate": 4.988299619209972e-05,
2502
+ "loss": 0.7181,
2503
+ "step": 405
2504
+ },
2505
+ {
2506
+ "epoch": 0.04,
2507
+ "learning_rate": 4.988222830019559e-05,
2508
+ "loss": 1.1963,
2509
+ "step": 406
2510
+ },
2511
+ {
2512
+ "epoch": 0.04,
2513
+ "learning_rate": 4.988145790265175e-05,
2514
+ "loss": 0.9929,
2515
+ "step": 407
2516
+ },
2517
+ {
2518
+ "epoch": 0.04,
2519
+ "learning_rate": 4.988068499954578e-05,
2520
+ "loss": 1.2016,
2521
+ "step": 408
2522
+ },
2523
+ {
2524
+ "epoch": 0.04,
2525
+ "learning_rate": 4.9879909590955515e-05,
2526
+ "loss": 1.2947,
2527
+ "step": 409
2528
+ },
2529
+ {
2530
+ "epoch": 0.04,
2531
+ "learning_rate": 4.987913167695904e-05,
2532
+ "loss": 0.9717,
2533
+ "step": 410
2534
+ },
2535
+ {
2536
+ "epoch": 0.04,
2537
+ "learning_rate": 4.987835125763468e-05,
2538
+ "loss": 0.94,
2539
+ "step": 411
2540
+ },
2541
+ {
2542
+ "epoch": 0.04,
2543
+ "learning_rate": 4.987756833306102e-05,
2544
+ "loss": 0.7971,
2545
+ "step": 412
2546
+ },
2547
+ {
2548
+ "epoch": 0.04,
2549
+ "learning_rate": 4.987678290331692e-05,
2550
+ "loss": 0.7798,
2551
+ "step": 413
2552
+ },
2553
+ {
2554
+ "epoch": 0.04,
2555
+ "learning_rate": 4.9875994968481465e-05,
2556
+ "loss": 0.9427,
2557
+ "step": 414
2558
+ },
2559
+ {
2560
+ "epoch": 0.04,
2561
+ "learning_rate": 4.987520452863399e-05,
2562
+ "loss": 0.971,
2563
+ "step": 415
2564
+ },
2565
+ {
2566
+ "epoch": 0.04,
2567
+ "learning_rate": 4.9874411583854106e-05,
2568
+ "loss": 0.9795,
2569
+ "step": 416
2570
+ },
2571
+ {
2572
+ "epoch": 0.04,
2573
+ "learning_rate": 4.9873616134221654e-05,
2574
+ "loss": 0.9382,
2575
+ "step": 417
2576
+ },
2577
+ {
2578
+ "epoch": 0.04,
2579
+ "learning_rate": 4.987281817981674e-05,
2580
+ "loss": 1.214,
2581
+ "step": 418
2582
+ },
2583
+ {
2584
+ "epoch": 0.04,
2585
+ "learning_rate": 4.987201772071971e-05,
2586
+ "loss": 1.0475,
2587
+ "step": 419
2588
+ },
2589
+ {
2590
+ "epoch": 0.04,
2591
+ "learning_rate": 4.9871214757011176e-05,
2592
+ "loss": 0.9213,
2593
+ "step": 420
2594
+ },
2595
+ {
2596
+ "epoch": 0.04,
2597
+ "learning_rate": 4.9870409288772005e-05,
2598
+ "loss": 0.7616,
2599
+ "step": 421
2600
+ },
2601
+ {
2602
+ "epoch": 0.04,
2603
+ "learning_rate": 4.9869601316083284e-05,
2604
+ "loss": 0.8741,
2605
+ "step": 422
2606
+ },
2607
+ {
2608
+ "epoch": 0.04,
2609
+ "learning_rate": 4.9868790839026404e-05,
2610
+ "loss": 1.1203,
2611
+ "step": 423
2612
+ },
2613
+ {
2614
+ "epoch": 0.04,
2615
+ "learning_rate": 4.9867977857682965e-05,
2616
+ "loss": 1.0697,
2617
+ "step": 424
2618
+ },
2619
+ {
2620
+ "epoch": 0.04,
2621
+ "learning_rate": 4.986716237213484e-05,
2622
+ "loss": 1.9062,
2623
+ "step": 425
2624
+ },
2625
+ {
2626
+ "epoch": 0.04,
2627
+ "learning_rate": 4.986634438246413e-05,
2628
+ "loss": 0.8906,
2629
+ "step": 426
2630
+ },
2631
+ {
2632
+ "epoch": 0.04,
2633
+ "learning_rate": 4.986552388875323e-05,
2634
+ "loss": 0.5871,
2635
+ "step": 427
2636
+ },
2637
+ {
2638
+ "epoch": 0.04,
2639
+ "learning_rate": 4.9864700891084756e-05,
2640
+ "loss": 0.7346,
2641
+ "step": 428
2642
+ },
2643
+ {
2644
+ "epoch": 0.04,
2645
+ "learning_rate": 4.986387538954158e-05,
2646
+ "loss": 1.0784,
2647
+ "step": 429
2648
+ },
2649
+ {
2650
+ "epoch": 0.04,
2651
+ "learning_rate": 4.9863047384206835e-05,
2652
+ "loss": 0.8797,
2653
+ "step": 430
2654
+ },
2655
+ {
2656
+ "epoch": 0.04,
2657
+ "learning_rate": 4.9862216875163896e-05,
2658
+ "loss": 0.7312,
2659
+ "step": 431
2660
+ },
2661
+ {
2662
+ "epoch": 0.04,
2663
+ "learning_rate": 4.9861383862496405e-05,
2664
+ "loss": 0.7475,
2665
+ "step": 432
2666
+ },
2667
+ {
2668
+ "epoch": 0.04,
2669
+ "learning_rate": 4.986054834628823e-05,
2670
+ "loss": 0.7619,
2671
+ "step": 433
2672
+ },
2673
+ {
2674
+ "epoch": 0.04,
2675
+ "learning_rate": 4.985971032662352e-05,
2676
+ "loss": 0.8597,
2677
+ "step": 434
2678
+ },
2679
+ {
2680
+ "epoch": 0.04,
2681
+ "learning_rate": 4.985886980358666e-05,
2682
+ "loss": 0.5565,
2683
+ "step": 435
2684
+ },
2685
+ {
2686
+ "epoch": 0.04,
2687
+ "learning_rate": 4.9858026777262295e-05,
2688
+ "loss": 0.9844,
2689
+ "step": 436
2690
+ },
2691
+ {
2692
+ "epoch": 0.04,
2693
+ "learning_rate": 4.9857181247735306e-05,
2694
+ "loss": 0.9608,
2695
+ "step": 437
2696
+ },
2697
+ {
2698
+ "epoch": 0.04,
2699
+ "learning_rate": 4.985633321509085e-05,
2700
+ "loss": 0.5236,
2701
+ "step": 438
2702
+ },
2703
+ {
2704
+ "epoch": 0.04,
2705
+ "learning_rate": 4.9855482679414324e-05,
2706
+ "loss": 0.9641,
2707
+ "step": 439
2708
+ },
2709
+ {
2710
+ "epoch": 0.04,
2711
+ "learning_rate": 4.985462964079137e-05,
2712
+ "loss": 0.684,
2713
+ "step": 440
2714
+ },
2715
+ {
2716
+ "epoch": 0.04,
2717
+ "learning_rate": 4.985377409930789e-05,
2718
+ "loss": 0.8992,
2719
+ "step": 441
2720
+ },
2721
+ {
2722
+ "epoch": 0.04,
2723
+ "learning_rate": 4.9852916055050035e-05,
2724
+ "loss": 0.9615,
2725
+ "step": 442
2726
+ },
2727
+ {
2728
+ "epoch": 0.04,
2729
+ "learning_rate": 4.985205550810421e-05,
2730
+ "loss": 1.1244,
2731
+ "step": 443
2732
+ },
2733
+ {
2734
+ "epoch": 0.04,
2735
+ "learning_rate": 4.985119245855708e-05,
2736
+ "loss": 0.561,
2737
+ "step": 444
2738
+ },
2739
+ {
2740
+ "epoch": 0.04,
2741
+ "learning_rate": 4.985032690649556e-05,
2742
+ "loss": 1.3473,
2743
+ "step": 445
2744
+ },
2745
+ {
2746
+ "epoch": 0.04,
2747
+ "learning_rate": 4.984945885200679e-05,
2748
+ "loss": 1.1382,
2749
+ "step": 446
2750
+ },
2751
+ {
2752
+ "epoch": 0.04,
2753
+ "learning_rate": 4.984858829517819e-05,
2754
+ "loss": 1.2158,
2755
+ "step": 447
2756
+ },
2757
+ {
2758
+ "epoch": 0.04,
2759
+ "learning_rate": 4.984771523609744e-05,
2760
+ "loss": 1.1904,
2761
+ "step": 448
2762
+ },
2763
+ {
2764
+ "epoch": 0.04,
2765
+ "learning_rate": 4.984683967485243e-05,
2766
+ "loss": 1.2497,
2767
+ "step": 449
2768
+ },
2769
+ {
2770
+ "epoch": 0.04,
2771
+ "learning_rate": 4.984596161153136e-05,
2772
+ "loss": 1.2918,
2773
+ "step": 450
2774
+ },
2775
+ {
2776
+ "epoch": 0.04,
2777
+ "eval_loss": 0.9576648473739624,
2778
+ "eval_runtime": 19.5205,
2779
+ "eval_samples_per_second": 4.354,
2780
+ "eval_steps_per_second": 1.127,
2781
+ "step": 450
2782
+ },
2783
+ {
2784
+ "epoch": 0.05,
2785
+ "learning_rate": 4.9845081046222625e-05,
2786
+ "loss": 1.0766,
2787
+ "step": 451
2788
+ },
2789
+ {
2790
+ "epoch": 0.05,
2791
+ "learning_rate": 4.984419797901491e-05,
2792
+ "loss": 0.9402,
2793
+ "step": 452
2794
+ },
2795
+ {
2796
+ "epoch": 0.05,
2797
+ "learning_rate": 4.984331240999715e-05,
2798
+ "loss": 0.8675,
2799
+ "step": 453
2800
+ },
2801
+ {
2802
+ "epoch": 0.05,
2803
+ "learning_rate": 4.984242433925849e-05,
2804
+ "loss": 0.8824,
2805
+ "step": 454
2806
+ },
2807
+ {
2808
+ "epoch": 0.05,
2809
+ "learning_rate": 4.9841533766888395e-05,
2810
+ "loss": 0.9028,
2811
+ "step": 455
2812
+ },
2813
+ {
2814
+ "epoch": 0.05,
2815
+ "learning_rate": 4.984064069297652e-05,
2816
+ "loss": 0.9169,
2817
+ "step": 456
2818
+ },
2819
+ {
2820
+ "epoch": 0.05,
2821
+ "learning_rate": 4.9839745117612815e-05,
2822
+ "loss": 0.7909,
2823
+ "step": 457
2824
+ },
2825
+ {
2826
+ "epoch": 0.05,
2827
+ "learning_rate": 4.983884704088745e-05,
2828
+ "loss": 1.114,
2829
+ "step": 458
2830
+ },
2831
+ {
2832
+ "epoch": 0.05,
2833
+ "learning_rate": 4.9837946462890866e-05,
2834
+ "loss": 0.7843,
2835
+ "step": 459
2836
+ },
2837
+ {
2838
+ "epoch": 0.05,
2839
+ "learning_rate": 4.9837043383713753e-05,
2840
+ "loss": 0.7459,
2841
+ "step": 460
2842
+ },
2843
+ {
2844
+ "epoch": 0.05,
2845
+ "learning_rate": 4.983613780344706e-05,
2846
+ "loss": 0.6337,
2847
+ "step": 461
2848
+ },
2849
+ {
2850
+ "epoch": 0.05,
2851
+ "learning_rate": 4.9835229722181964e-05,
2852
+ "loss": 0.8813,
2853
+ "step": 462
2854
+ },
2855
+ {
2856
+ "epoch": 0.05,
2857
+ "learning_rate": 4.983431914000991e-05,
2858
+ "loss": 0.8415,
2859
+ "step": 463
2860
+ },
2861
+ {
2862
+ "epoch": 0.05,
2863
+ "learning_rate": 4.98334060570226e-05,
2864
+ "loss": 0.6781,
2865
+ "step": 464
2866
+ },
2867
+ {
2868
+ "epoch": 0.05,
2869
+ "learning_rate": 4.983249047331199e-05,
2870
+ "loss": 0.5927,
2871
+ "step": 465
2872
+ },
2873
+ {
2874
+ "epoch": 0.05,
2875
+ "learning_rate": 4.983157238897026e-05,
2876
+ "loss": 0.4942,
2877
+ "step": 466
2878
+ },
2879
+ {
2880
+ "epoch": 0.05,
2881
+ "learning_rate": 4.9830651804089864e-05,
2882
+ "loss": 0.7969,
2883
+ "step": 467
2884
+ },
2885
+ {
2886
+ "epoch": 0.05,
2887
+ "learning_rate": 4.982972871876353e-05,
2888
+ "loss": 0.8438,
2889
+ "step": 468
2890
+ },
2891
+ {
2892
+ "epoch": 0.05,
2893
+ "learning_rate": 4.982880313308417e-05,
2894
+ "loss": 0.6357,
2895
+ "step": 469
2896
+ },
2897
+ {
2898
+ "epoch": 0.05,
2899
+ "learning_rate": 4.982787504714503e-05,
2900
+ "loss": 0.8657,
2901
+ "step": 470
2902
+ },
2903
+ {
2904
+ "epoch": 0.05,
2905
+ "learning_rate": 4.982694446103955e-05,
2906
+ "loss": 0.9851,
2907
+ "step": 471
2908
+ },
2909
+ {
2910
+ "epoch": 0.05,
2911
+ "learning_rate": 4.9826011374861435e-05,
2912
+ "loss": 0.6133,
2913
+ "step": 472
2914
+ },
2915
+ {
2916
+ "epoch": 0.05,
2917
+ "learning_rate": 4.9825075788704656e-05,
2918
+ "loss": 0.8499,
2919
+ "step": 473
2920
+ },
2921
+ {
2922
+ "epoch": 0.05,
2923
+ "learning_rate": 4.982413770266342e-05,
2924
+ "loss": 0.9503,
2925
+ "step": 474
2926
+ },
2927
+ {
2928
+ "epoch": 0.05,
2929
+ "learning_rate": 4.982319711683221e-05,
2930
+ "loss": 0.6674,
2931
+ "step": 475
2932
+ },
2933
+ {
2934
+ "epoch": 0.05,
2935
+ "learning_rate": 4.982225403130572e-05,
2936
+ "loss": 0.6483,
2937
+ "step": 476
2938
+ },
2939
+ {
2940
+ "epoch": 0.05,
2941
+ "learning_rate": 4.9821308446178934e-05,
2942
+ "loss": 0.726,
2943
+ "step": 477
2944
+ },
2945
+ {
2946
+ "epoch": 0.05,
2947
+ "learning_rate": 4.982036036154706e-05,
2948
+ "loss": 0.7089,
2949
+ "step": 478
2950
+ },
2951
+ {
2952
+ "epoch": 0.05,
2953
+ "learning_rate": 4.981940977750558e-05,
2954
+ "loss": 0.7825,
2955
+ "step": 479
2956
+ },
2957
+ {
2958
+ "epoch": 0.05,
2959
+ "learning_rate": 4.981845669415022e-05,
2960
+ "loss": 0.8739,
2961
+ "step": 480
2962
+ },
2963
+ {
2964
+ "epoch": 0.05,
2965
+ "learning_rate": 4.981750111157694e-05,
2966
+ "loss": 0.83,
2967
+ "step": 481
2968
+ },
2969
+ {
2970
+ "epoch": 0.05,
2971
+ "learning_rate": 4.981654302988198e-05,
2972
+ "loss": 0.5891,
2973
+ "step": 482
2974
+ },
2975
+ {
2976
+ "epoch": 0.05,
2977
+ "learning_rate": 4.981558244916182e-05,
2978
+ "loss": 0.8019,
2979
+ "step": 483
2980
+ },
2981
+ {
2982
+ "epoch": 0.05,
2983
+ "learning_rate": 4.9814619369513184e-05,
2984
+ "loss": 0.9172,
2985
+ "step": 484
2986
+ },
2987
+ {
2988
+ "epoch": 0.05,
2989
+ "learning_rate": 4.9813653791033057e-05,
2990
+ "loss": 0.9098,
2991
+ "step": 485
2992
+ },
2993
+ {
2994
+ "epoch": 0.05,
2995
+ "learning_rate": 4.981268571381867e-05,
2996
+ "loss": 1.0725,
2997
+ "step": 486
2998
+ },
2999
+ {
3000
+ "epoch": 0.05,
3001
+ "learning_rate": 4.981171513796751e-05,
3002
+ "loss": 0.3633,
3003
+ "step": 487
3004
+ },
3005
+ {
3006
+ "epoch": 0.05,
3007
+ "learning_rate": 4.981074206357731e-05,
3008
+ "loss": 0.7164,
3009
+ "step": 488
3010
+ },
3011
+ {
3012
+ "epoch": 0.05,
3013
+ "learning_rate": 4.9809766490746074e-05,
3014
+ "loss": 0.9008,
3015
+ "step": 489
3016
+ },
3017
+ {
3018
+ "epoch": 0.05,
3019
+ "learning_rate": 4.980878841957203e-05,
3020
+ "loss": 0.7623,
3021
+ "step": 490
3022
+ },
3023
+ {
3024
+ "epoch": 0.05,
3025
+ "learning_rate": 4.980780785015367e-05,
3026
+ "loss": 1.4832,
3027
+ "step": 491
3028
+ },
3029
+ {
3030
+ "epoch": 0.05,
3031
+ "learning_rate": 4.9806824782589737e-05,
3032
+ "loss": 0.975,
3033
+ "step": 492
3034
+ },
3035
+ {
3036
+ "epoch": 0.05,
3037
+ "learning_rate": 4.980583921697922e-05,
3038
+ "loss": 0.6389,
3039
+ "step": 493
3040
+ },
3041
+ {
3042
+ "epoch": 0.05,
3043
+ "learning_rate": 4.980485115342138e-05,
3044
+ "loss": 0.121,
3045
+ "step": 494
3046
+ },
3047
+ {
3048
+ "epoch": 0.05,
3049
+ "learning_rate": 4.9803860592015704e-05,
3050
+ "loss": 0.0237,
3051
+ "step": 495
3052
+ },
3053
+ {
3054
+ "epoch": 0.05,
3055
+ "learning_rate": 4.980286753286195e-05,
3056
+ "loss": 0.0194,
3057
+ "step": 496
3058
+ },
3059
+ {
3060
+ "epoch": 0.05,
3061
+ "learning_rate": 4.980187197606011e-05,
3062
+ "loss": 0.0152,
3063
+ "step": 497
3064
+ },
3065
+ {
3066
+ "epoch": 0.05,
3067
+ "learning_rate": 4.980087392171045e-05,
3068
+ "loss": 0.0164,
3069
+ "step": 498
3070
+ },
3071
+ {
3072
+ "epoch": 0.05,
3073
+ "learning_rate": 4.979987336991345e-05,
3074
+ "loss": 0.0165,
3075
+ "step": 499
3076
+ },
3077
+ {
3078
+ "epoch": 0.05,
3079
+ "learning_rate": 4.9798870320769886e-05,
3080
+ "loss": 0.0137,
3081
+ "step": 500
3082
+ },
3083
+ {
3084
+ "epoch": 0.05,
3085
+ "eval_loss": 0.9486321210861206,
3086
+ "eval_runtime": 19.1419,
3087
+ "eval_samples_per_second": 4.441,
3088
+ "eval_steps_per_second": 1.149,
3089
+ "step": 500
3090
+ },
3091
+ {
3092
+ "epoch": 0.05,
3093
+ "learning_rate": 4.979786477438076e-05,
3094
+ "loss": 0.0126,
3095
+ "step": 501
3096
+ },
3097
+ {
3098
+ "epoch": 0.05,
3099
+ "learning_rate": 4.979685673084733e-05,
3100
+ "loss": 0.0104,
3101
+ "step": 502
3102
+ },
3103
+ {
3104
+ "epoch": 0.05,
3105
+ "learning_rate": 4.97958461902711e-05,
3106
+ "loss": 0.016,
3107
+ "step": 503
3108
+ },
3109
+ {
3110
+ "epoch": 0.05,
3111
+ "learning_rate": 4.979483315275385e-05,
3112
+ "loss": 0.0228,
3113
+ "step": 504
3114
+ },
3115
+ {
3116
+ "epoch": 0.05,
3117
+ "learning_rate": 4.979381761839757e-05,
3118
+ "loss": 0.0369,
3119
+ "step": 505
3120
+ },
3121
+ {
3122
+ "epoch": 0.05,
3123
+ "learning_rate": 4.979279958730454e-05,
3124
+ "loss": 0.0144,
3125
+ "step": 506
3126
+ },
3127
+ {
3128
+ "epoch": 0.05,
3129
+ "learning_rate": 4.979177905957726e-05,
3130
+ "loss": 0.0084,
3131
+ "step": 507
3132
+ },
3133
+ {
3134
+ "epoch": 0.05,
3135
+ "learning_rate": 4.979075603531852e-05,
3136
+ "loss": 0.0115,
3137
+ "step": 508
3138
+ },
3139
+ {
3140
+ "epoch": 0.05,
3141
+ "learning_rate": 4.978973051463132e-05,
3142
+ "loss": 0.0105,
3143
+ "step": 509
3144
+ },
3145
+ {
3146
+ "epoch": 0.05,
3147
+ "learning_rate": 4.978870249761893e-05,
3148
+ "loss": 0.0183,
3149
+ "step": 510
3150
+ },
3151
+ {
3152
+ "epoch": 0.05,
3153
+ "learning_rate": 4.978767198438488e-05,
3154
+ "loss": 0.0118,
3155
+ "step": 511
3156
+ },
3157
+ {
3158
+ "epoch": 0.05,
3159
+ "learning_rate": 4.978663897503294e-05,
3160
+ "loss": 0.4027,
3161
+ "step": 512
3162
+ },
3163
+ {
3164
+ "epoch": 0.05,
3165
+ "learning_rate": 4.978560346966714e-05,
3166
+ "loss": 0.6452,
3167
+ "step": 513
3168
+ },
3169
+ {
3170
+ "epoch": 0.05,
3171
+ "learning_rate": 4.978456546839174e-05,
3172
+ "loss": 0.8626,
3173
+ "step": 514
3174
+ },
3175
+ {
3176
+ "epoch": 0.05,
3177
+ "learning_rate": 4.978352497131128e-05,
3178
+ "loss": 0.475,
3179
+ "step": 515
3180
+ },
3181
+ {
3182
+ "epoch": 0.05,
3183
+ "learning_rate": 4.978248197853053e-05,
3184
+ "loss": 1.0023,
3185
+ "step": 516
3186
+ },
3187
+ {
3188
+ "epoch": 0.05,
3189
+ "learning_rate": 4.978143649015452e-05,
3190
+ "loss": 0.2236,
3191
+ "step": 517
3192
+ },
3193
+ {
3194
+ "epoch": 0.05,
3195
+ "learning_rate": 4.978038850628854e-05,
3196
+ "loss": 2.3618,
3197
+ "step": 518
3198
+ },
3199
+ {
3200
+ "epoch": 0.05,
3201
+ "learning_rate": 4.977933802703812e-05,
3202
+ "loss": 0.7232,
3203
+ "step": 519
3204
+ },
3205
+ {
3206
+ "epoch": 0.05,
3207
+ "learning_rate": 4.977828505250903e-05,
3208
+ "loss": 0.8647,
3209
+ "step": 520
3210
+ },
3211
+ {
3212
+ "epoch": 0.05,
3213
+ "learning_rate": 4.9777229582807316e-05,
3214
+ "loss": 1.0719,
3215
+ "step": 521
3216
+ },
3217
+ {
3218
+ "epoch": 0.05,
3219
+ "learning_rate": 4.9776171618039264e-05,
3220
+ "loss": 1.2616,
3221
+ "step": 522
3222
+ },
3223
+ {
3224
+ "epoch": 0.05,
3225
+ "learning_rate": 4.977511115831141e-05,
3226
+ "loss": 1.0388,
3227
+ "step": 523
3228
+ },
3229
+ {
3230
+ "epoch": 0.05,
3231
+ "learning_rate": 4.9774048203730526e-05,
3232
+ "loss": 0.9671,
3233
+ "step": 524
3234
+ },
3235
+ {
3236
+ "epoch": 0.05,
3237
+ "learning_rate": 4.977298275440368e-05,
3238
+ "loss": 0.914,
3239
+ "step": 525
3240
+ },
3241
+ {
3242
+ "epoch": 0.05,
3243
+ "learning_rate": 4.9771914810438144e-05,
3244
+ "loss": 0.7392,
3245
+ "step": 526
3246
+ },
3247
+ {
3248
+ "epoch": 0.05,
3249
+ "learning_rate": 4.977084437194146e-05,
3250
+ "loss": 1.0531,
3251
+ "step": 527
3252
+ },
3253
+ {
3254
+ "epoch": 0.05,
3255
+ "learning_rate": 4.976977143902143e-05,
3256
+ "loss": 0.8884,
3257
+ "step": 528
3258
+ },
3259
+ {
3260
+ "epoch": 0.05,
3261
+ "learning_rate": 4.976869601178609e-05,
3262
+ "loss": 0.5084,
3263
+ "step": 529
3264
+ },
3265
+ {
3266
+ "epoch": 0.05,
3267
+ "learning_rate": 4.9767618090343745e-05,
3268
+ "loss": 0.8287,
3269
+ "step": 530
3270
+ },
3271
+ {
3272
+ "epoch": 0.05,
3273
+ "learning_rate": 4.976653767480293e-05,
3274
+ "loss": 2.2692,
3275
+ "step": 531
3276
+ },
3277
+ {
3278
+ "epoch": 0.05,
3279
+ "learning_rate": 4.976545476527246e-05,
3280
+ "loss": 1.0015,
3281
+ "step": 532
3282
+ },
3283
+ {
3284
+ "epoch": 0.05,
3285
+ "learning_rate": 4.976436936186136e-05,
3286
+ "loss": 1.0404,
3287
+ "step": 533
3288
+ },
3289
+ {
3290
+ "epoch": 0.05,
3291
+ "learning_rate": 4.976328146467895e-05,
3292
+ "loss": 1.108,
3293
+ "step": 534
3294
+ },
3295
+ {
3296
+ "epoch": 0.05,
3297
+ "learning_rate": 4.9762191073834776e-05,
3298
+ "loss": 1.0678,
3299
+ "step": 535
3300
+ },
3301
+ {
3302
+ "epoch": 0.05,
3303
+ "learning_rate": 4.976109818943863e-05,
3304
+ "loss": 1.1611,
3305
+ "step": 536
3306
+ },
3307
+ {
3308
+ "epoch": 0.05,
3309
+ "learning_rate": 4.976000281160057e-05,
3310
+ "loss": 1.019,
3311
+ "step": 537
3312
+ },
3313
+ {
3314
+ "epoch": 0.05,
3315
+ "learning_rate": 4.975890494043092e-05,
3316
+ "loss": 0.8593,
3317
+ "step": 538
3318
+ },
3319
+ {
3320
+ "epoch": 0.05,
3321
+ "learning_rate": 4.975780457604021e-05,
3322
+ "loss": 0.9699,
3323
+ "step": 539
3324
+ },
3325
+ {
3326
+ "epoch": 0.05,
3327
+ "learning_rate": 4.975670171853926e-05,
3328
+ "loss": 0.8718,
3329
+ "step": 540
3330
+ },
3331
+ {
3332
+ "epoch": 0.05,
3333
+ "learning_rate": 4.975559636803913e-05,
3334
+ "loss": 0.865,
3335
+ "step": 541
3336
+ },
3337
+ {
3338
+ "epoch": 0.05,
3339
+ "learning_rate": 4.975448852465111e-05,
3340
+ "loss": 1.1793,
3341
+ "step": 542
3342
+ },
3343
+ {
3344
+ "epoch": 0.05,
3345
+ "learning_rate": 4.9753378188486776e-05,
3346
+ "loss": 0.4275,
3347
+ "step": 543
3348
+ },
3349
+ {
3350
+ "epoch": 0.05,
3351
+ "learning_rate": 4.975226535965795e-05,
3352
+ "loss": 0.8263,
3353
+ "step": 544
3354
+ },
3355
+ {
3356
+ "epoch": 0.05,
3357
+ "learning_rate": 4.975115003827666e-05,
3358
+ "loss": 0.6425,
3359
+ "step": 545
3360
+ },
3361
+ {
3362
+ "epoch": 0.05,
3363
+ "learning_rate": 4.9750032224455244e-05,
3364
+ "loss": 0.8046,
3365
+ "step": 546
3366
+ },
3367
+ {
3368
+ "epoch": 0.05,
3369
+ "learning_rate": 4.974891191830627e-05,
3370
+ "loss": 0.8646,
3371
+ "step": 547
3372
+ },
3373
+ {
3374
+ "epoch": 0.05,
3375
+ "learning_rate": 4.974778911994254e-05,
3376
+ "loss": 0.8854,
3377
+ "step": 548
3378
+ },
3379
+ {
3380
+ "epoch": 0.05,
3381
+ "learning_rate": 4.9746663829477113e-05,
3382
+ "loss": 0.7902,
3383
+ "step": 549
3384
+ },
3385
+ {
3386
+ "epoch": 0.06,
3387
+ "learning_rate": 4.9745536047023324e-05,
3388
+ "loss": 0.908,
3389
+ "step": 550
3390
+ },
3391
+ {
3392
+ "epoch": 0.06,
3393
+ "eval_loss": 0.9434943795204163,
3394
+ "eval_runtime": 19.2357,
3395
+ "eval_samples_per_second": 4.419,
3396
+ "eval_steps_per_second": 1.144,
3397
+ "step": 550
3398
+ },
3399
+ {
3400
+ "epoch": 0.06,
3401
+ "learning_rate": 4.9744405772694725e-05,
3402
+ "loss": 0.9434,
3403
+ "step": 551
3404
+ },
3405
+ {
3406
+ "epoch": 0.06,
3407
+ "learning_rate": 4.974327300660515e-05,
3408
+ "loss": 0.762,
3409
+ "step": 552
3410
+ },
3411
+ {
3412
+ "epoch": 0.06,
3413
+ "learning_rate": 4.974213774886865e-05,
3414
+ "loss": 0.503,
3415
+ "step": 553
3416
+ },
3417
+ {
3418
+ "epoch": 0.06,
3419
+ "learning_rate": 4.974099999959957e-05,
3420
+ "loss": 0.8842,
3421
+ "step": 554
3422
+ },
3423
+ {
3424
+ "epoch": 0.06,
3425
+ "learning_rate": 4.973985975891245e-05,
3426
+ "loss": 1.0368,
3427
+ "step": 555
3428
+ },
3429
+ {
3430
+ "epoch": 0.06,
3431
+ "learning_rate": 4.973871702692214e-05,
3432
+ "loss": 1.037,
3433
+ "step": 556
3434
+ },
3435
+ {
3436
+ "epoch": 0.06,
3437
+ "learning_rate": 4.9737571803743706e-05,
3438
+ "loss": 1.6872,
3439
+ "step": 557
3440
+ },
3441
+ {
3442
+ "epoch": 0.06,
3443
+ "learning_rate": 4.973642408949246e-05,
3444
+ "loss": 0.6864,
3445
+ "step": 558
3446
+ },
3447
+ {
3448
+ "epoch": 0.06,
3449
+ "learning_rate": 4.973527388428399e-05,
3450
+ "loss": 0.7262,
3451
+ "step": 559
3452
+ },
3453
+ {
3454
+ "epoch": 0.06,
3455
+ "learning_rate": 4.973412118823412e-05,
3456
+ "loss": 0.6918,
3457
+ "step": 560
3458
+ },
3459
+ {
3460
+ "epoch": 0.06,
3461
+ "learning_rate": 4.9732966001458916e-05,
3462
+ "loss": 0.796,
3463
+ "step": 561
3464
+ },
3465
+ {
3466
+ "epoch": 0.06,
3467
+ "learning_rate": 4.9731808324074717e-05,
3468
+ "loss": 0.9667,
3469
+ "step": 562
3470
+ },
3471
+ {
3472
+ "epoch": 0.06,
3473
+ "learning_rate": 4.973064815619809e-05,
3474
+ "loss": 1.0184,
3475
+ "step": 563
3476
+ },
3477
+ {
3478
+ "epoch": 0.06,
3479
+ "learning_rate": 4.972948549794587e-05,
3480
+ "loss": 0.6911,
3481
+ "step": 564
3482
+ },
3483
+ {
3484
+ "epoch": 0.06,
3485
+ "learning_rate": 4.972832034943514e-05,
3486
+ "loss": 0.7089,
3487
+ "step": 565
3488
+ },
3489
+ {
3490
+ "epoch": 0.06,
3491
+ "learning_rate": 4.9727152710783235e-05,
3492
+ "loss": 0.7468,
3493
+ "step": 566
3494
+ },
3495
+ {
3496
+ "epoch": 0.06,
3497
+ "learning_rate": 4.9725982582107715e-05,
3498
+ "loss": 0.8661,
3499
+ "step": 567
3500
+ },
3501
+ {
3502
+ "epoch": 0.06,
3503
+ "learning_rate": 4.972480996352644e-05,
3504
+ "loss": 0.6693,
3505
+ "step": 568
3506
+ },
3507
+ {
3508
+ "epoch": 0.06,
3509
+ "learning_rate": 4.972363485515746e-05,
3510
+ "loss": 0.8081,
3511
+ "step": 569
3512
+ },
3513
+ {
3514
+ "epoch": 0.06,
3515
+ "learning_rate": 4.972245725711914e-05,
3516
+ "loss": 0.0205,
3517
+ "step": 570
3518
+ },
3519
+ {
3520
+ "epoch": 0.06,
3521
+ "learning_rate": 4.972127716953005e-05,
3522
+ "loss": 0.0135,
3523
+ "step": 571
3524
+ },
3525
+ {
3526
+ "epoch": 0.06,
3527
+ "learning_rate": 4.972009459250903e-05,
3528
+ "loss": 0.0154,
3529
+ "step": 572
3530
+ },
3531
+ {
3532
+ "epoch": 0.06,
3533
+ "learning_rate": 4.971890952617515e-05,
3534
+ "loss": 0.0152,
3535
+ "step": 573
3536
+ },
3537
+ {
3538
+ "epoch": 0.06,
3539
+ "learning_rate": 4.9717721970647754e-05,
3540
+ "loss": 0.0135,
3541
+ "step": 574
3542
+ },
3543
+ {
3544
+ "epoch": 0.06,
3545
+ "learning_rate": 4.9716531926046446e-05,
3546
+ "loss": 0.0149,
3547
+ "step": 575
3548
+ },
3549
+ {
3550
+ "epoch": 0.06,
3551
+ "learning_rate": 4.971533939249105e-05,
3552
+ "loss": 0.014,
3553
+ "step": 576
3554
+ },
3555
+ {
3556
+ "epoch": 0.06,
3557
+ "learning_rate": 4.971414437010163e-05,
3558
+ "loss": 0.01,
3559
+ "step": 577
3560
+ },
3561
+ {
3562
+ "epoch": 0.06,
3563
+ "learning_rate": 4.971294685899857e-05,
3564
+ "loss": 0.0132,
3565
+ "step": 578
3566
+ },
3567
+ {
3568
+ "epoch": 0.06,
3569
+ "learning_rate": 4.9711746859302436e-05,
3570
+ "loss": 0.0095,
3571
+ "step": 579
3572
+ },
3573
+ {
3574
+ "epoch": 0.06,
3575
+ "learning_rate": 4.971054437113406e-05,
3576
+ "loss": 0.0153,
3577
+ "step": 580
3578
+ },
3579
+ {
3580
+ "epoch": 0.06,
3581
+ "learning_rate": 4.970933939461455e-05,
3582
+ "loss": 0.0345,
3583
+ "step": 581
3584
+ },
3585
+ {
3586
+ "epoch": 0.06,
3587
+ "learning_rate": 4.970813192986524e-05,
3588
+ "loss": 0.0108,
3589
+ "step": 582
3590
+ },
3591
+ {
3592
+ "epoch": 0.06,
3593
+ "learning_rate": 4.9706921977007714e-05,
3594
+ "loss": 0.015,
3595
+ "step": 583
3596
+ },
3597
+ {
3598
+ "epoch": 0.06,
3599
+ "learning_rate": 4.9705709536163824e-05,
3600
+ "loss": 0.0153,
3601
+ "step": 584
3602
+ },
3603
+ {
3604
+ "epoch": 0.06,
3605
+ "learning_rate": 4.970449460745566e-05,
3606
+ "loss": 0.0116,
3607
+ "step": 585
3608
+ },
3609
+ {
3610
+ "epoch": 0.06,
3611
+ "learning_rate": 4.9703277191005556e-05,
3612
+ "loss": 0.0115,
3613
+ "step": 586
3614
+ },
3615
+ {
3616
+ "epoch": 0.06,
3617
+ "learning_rate": 4.970205728693613e-05,
3618
+ "loss": 0.139,
3619
+ "step": 587
3620
+ },
3621
+ {
3622
+ "epoch": 0.06,
3623
+ "learning_rate": 4.970083489537021e-05,
3624
+ "loss": 0.4434,
3625
+ "step": 588
3626
+ },
3627
+ {
3628
+ "epoch": 0.06,
3629
+ "learning_rate": 4.969961001643088e-05,
3630
+ "loss": 0.7731,
3631
+ "step": 589
3632
+ },
3633
+ {
3634
+ "epoch": 0.06,
3635
+ "learning_rate": 4.969838265024151e-05,
3636
+ "loss": 0.6826,
3637
+ "step": 590
3638
+ },
3639
+ {
3640
+ "epoch": 0.06,
3641
+ "learning_rate": 4.9697152796925674e-05,
3642
+ "loss": 1.732,
3643
+ "step": 591
3644
+ },
3645
+ {
3646
+ "epoch": 0.06,
3647
+ "learning_rate": 4.9695920456607226e-05,
3648
+ "loss": 1.4832,
3649
+ "step": 592
3650
+ },
3651
+ {
3652
+ "epoch": 0.06,
3653
+ "learning_rate": 4.9694685629410264e-05,
3654
+ "loss": 0.7681,
3655
+ "step": 593
3656
+ },
3657
+ {
3658
+ "epoch": 0.06,
3659
+ "learning_rate": 4.969344831545914e-05,
3660
+ "loss": 0.9764,
3661
+ "step": 594
3662
+ },
3663
+ {
3664
+ "epoch": 0.06,
3665
+ "learning_rate": 4.9692208514878444e-05,
3666
+ "loss": 1.0405,
3667
+ "step": 595
3668
+ },
3669
+ {
3670
+ "epoch": 0.06,
3671
+ "learning_rate": 4.969096622779303e-05,
3672
+ "loss": 0.773,
3673
+ "step": 596
3674
+ },
3675
+ {
3676
+ "epoch": 0.06,
3677
+ "learning_rate": 4.9689721454327985e-05,
3678
+ "loss": 0.9574,
3679
+ "step": 597
3680
+ },
3681
+ {
3682
+ "epoch": 0.06,
3683
+ "learning_rate": 4.968847419460867e-05,
3684
+ "loss": 0.9658,
3685
+ "step": 598
3686
+ },
3687
+ {
3688
+ "epoch": 0.06,
3689
+ "learning_rate": 4.9687224448760685e-05,
3690
+ "loss": 0.8794,
3691
+ "step": 599
3692
+ },
3693
+ {
3694
+ "epoch": 0.06,
3695
+ "learning_rate": 4.968597221690986e-05,
3696
+ "loss": 0.8777,
3697
+ "step": 600
3698
+ },
3699
+ {
3700
+ "epoch": 0.06,
3701
+ "eval_loss": 0.93730229139328,
3702
+ "eval_runtime": 20.1845,
3703
+ "eval_samples_per_second": 4.211,
3704
+ "eval_steps_per_second": 1.09,
3705
+ "step": 600
3706
+ }
3707
+ ],
3708
+ "logging_steps": 1,
3709
+ "max_steps": 10000,
3710
+ "num_train_epochs": 9223372036854775807,
3711
+ "save_steps": 100,
3712
+ "total_flos": 2.79402856316928e+16,
3713
+ "trial_name": null,
3714
+ "trial_params": null
3715
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36d70c743b7de4a3c204d42e55c6ed5af15587766757d8fc01ede2f531e11802
3
+ size 4015