mlinmg commited on
Commit
cd4953a
·
1 Parent(s): 4af9788

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -48,6 +48,12 @@ The layer ranges used are as follows:
48
  layer_range: [45, 59]
49
  ```
50
 
 
 
 
 
 
 
51
 
52
  # Benchmarks
53
  Coming soon.
 
48
  layer_range: [45, 59]
49
  ```
50
 
51
+ # Tips
52
+
53
+ Being a Yi model, try disabling the BOS token and/or running a lower temperature with MinP (and no other samplers) if output doesn't seem right. Yi tends to run "hot" by default.
54
+
55
+ Sometimes the model "spells out" the stop token as </s> like Capybara, so you may need to add </s> as an additional stopping condition.
56
+
57
 
58
  # Benchmarks
59
  Coming soon.