added alt parameter settings
Browse files
README.md
CHANGED
@@ -45,12 +45,20 @@ For optimal performance, `Disinfo4_mistral-ft-optimized-1218` should be utilized
|
|
45 |
### Mirostat Parameters
|
46 |
|
47 |
- **Temperature (Temp):** 1
|
48 |
-
- **Top-p (top_p):** 1
|
49 |
- **Mirostat Tau:** 7.19
|
50 |
- **Mirostat Eta:** 0.01
|
51 |
- **Mirostat Mode:** 2
|
52 |
- **Others:** Default or disabled
|
53 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
54 |
## Additional Configuration
|
55 |
|
56 |
This model uses the default Mistral 8k/32k context window.
|
|
|
45 |
### Mirostat Parameters
|
46 |
|
47 |
- **Temperature (Temp):** 1
|
|
|
48 |
- **Mirostat Tau:** 7.19
|
49 |
- **Mirostat Eta:** 0.01
|
50 |
- **Mirostat Mode:** 2
|
51 |
- **Others:** Default or disabled
|
52 |
|
53 |
+
This model works best with mirostat! If you don't have that option, the below settings are sort of as creative, though they are also more prone to errors:
|
54 |
+
- **Temp:** 4
|
55 |
+
- **Top K:** 40
|
56 |
+
- **Repeat Penalty:** 1.1
|
57 |
+
- **Min P:** 0.001 (0.01 if your app doesn't allow lower)
|
58 |
+
- **Top P:** disabled (top P absolutely lobotomizes language though it improves accuracy etc.)
|
59 |
+
|
60 |
+
This model *loves* to hallucinate books, quotes, etc but what do you expect from the disinfo.zone?
|
61 |
+
|
62 |
## Additional Configuration
|
63 |
|
64 |
This model uses the default Mistral 8k/32k context window.
|