Update README.md
Browse files
README.md
CHANGED
@@ -48,6 +48,12 @@ The layer ranges used are as follows:
|
|
48 |
layer_range: [45, 59]
|
49 |
```
|
50 |
|
|
|
|
|
|
|
|
|
|
|
|
|
51 |
|
52 |
# Benchmarks
|
53 |
Coming soon.
|
|
|
48 |
layer_range: [45, 59]
|
49 |
```
|
50 |
|
51 |
+
# Tips
|
52 |
+
|
53 |
+
Being a Yi model, try disabling the BOS token and/or running a lower temperature with MinP (and no other samplers) if output doesn't seem right. Yi tends to run "hot" by default.
|
54 |
+
|
55 |
+
Sometimes the model "spells out" the stop token as </s> like Capybara, so you may need to add </s> as an additional stopping condition.
|
56 |
+
|
57 |
|
58 |
# Benchmarks
|
59 |
Coming soon.
|