Commit
•
b76c439
1
Parent(s):
1ab90af
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,10 @@ After I put down the joint and [RTFM](https://arxiv.org/pdf/2311.03099.pdf), I h
|
|
| 9 |
|
| 10 |
By lowering the density, I hit closer to the sweet-spot shown in the paper. Also, I'm using my fixed base model, so hopefully that helps too. Weights are adjusted to make the later layers more aligned with ORCA 2.
|
| 11 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
### Recipe
|
| 13 |
merge_method: dare_ties
|
| 14 |
|
|
|
|
| 9 |
|
| 10 |
By lowering the density, I hit closer to the sweet-spot shown in the paper. Also, I'm using my fixed base model, so hopefully that helps too. Weights are adjusted to make the later layers more aligned with ORCA 2.
|
| 11 |
|
| 12 |
+
### Results
|
| 13 |
+
|
| 14 |
+
I'm quite happy with this model for what it is, a personable and effective assistant. It does infodump a bit, but what genius doesn't? It writes okay erotica and general fiction, it just has an "artifical" tone.
|
| 15 |
+
|
| 16 |
### Recipe
|
| 17 |
merge_method: dare_ties
|
| 18 |
|