athirdpath
commited on
Commit
•
5346ca7
1
Parent(s):
c307c1a
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
### What the hell is going on here?
|
2 |
+
|
3 |
+
I have a theory! But, I have to go to bed, so I'm setting this to upload while I sleep.
|
4 |
+
|
5 |
+
The 13Bs struggled because they were inherently lopsided. So, with this layout, I not only free up more parameters for further finetuning, I also address the imbalance. Crazy? Maybe.
|