Add README
Browse files
README.md
CHANGED
|
@@ -32,4 +32,4 @@ python3 hf_merge.py to_merge_mixtral0.txt mixtral-0 -p 0.3 -lambda 2.1
|
|
| 32 |
## Notes
|
| 33 |
|
| 34 |
* This is primarily a test to see if merging mixtral models works.
|
| 35 |
-
*
|
|
|
|
| 32 |
## Notes
|
| 33 |
|
| 34 |
* This is primarily a test to see if merging mixtral models works.
|
| 35 |
+
* MoE gates are not merged.
|