nbeerbower
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -18,6 +18,6 @@ The goal was to reduce archaic language and purple prose in a completely uncenso
|
|
18 |
|
19 |
### Method
|
20 |
|
21 |
-
[ORPO tuned](https://mlabonne.github.io/blog/posts/2024-04-19_Fine_tune_Llama_3_with_ORPO.html) with
|
22 |
|
23 |
For this version, beta was increased to 0.3 and learning rate was increased to 5e-6.
|
|
|
18 |
|
19 |
### Method
|
20 |
|
21 |
+
[ORPO tuned](https://mlabonne.github.io/blog/posts/2024-04-19_Fine_tune_Llama_3_with_ORPO.html) with 8x A40 for 10 epochs.
|
22 |
|
23 |
For this version, beta was increased to 0.3 and learning rate was increased to 5e-6.
|