Update README.md

README.md

@@ -29,4 +29,66 @@ datasets:
 
 Use rwkv pip package 0.8.24+ for RWKV-6 inference: https://pypi.org/project/rwkv/ (pipeline = PIPELINE(model, "rwkv_vocab_v20230424") for rwkv-world models)
 
-Trained on same world-2 dataset as https://huggingface.co/BlinkDL/rwkv-5-world.
+Online Demo 1: https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-2
+
+Online Demo 2: https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-1
+
+GUI: https://github.com/josStorer/RWKV-Runner (see Releases)
+
+How it works: https://twitter.com/BlinkDL_AI/status/1685230712247795713
+
+https://www.rwkv.com/
+
+## Model Description
+
+RWKV-6 trained on 100+ world languages (70% English, 15% multilang, 15% code).
+
+World = Some_Pile + Some_SlimPajama + Some_StarCoder + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
+
+World v1 = 0.59T tokens
+
+World v2 = 1.12T tokens
+
+World v2.1 = 1.42T tokens
+
+Recommended fine-tuning format (use \n for newlines):
+```
+User: xxxxxxxxxxxxxxx
+
+Assistant: xxxxxxxxxxxxxxx
+xxxxxxxxxxxxxxx
+xxxxxxxxxxxxxxx
+
+User: xxxxxxxxxxxxxxx
+xxxxxxxxxxxxxxx
+
+Assistant: xxxxxxxxxxxxxxx
+xxxxxxxxxxxxxxx
+xxxxxxxxxxxxxxx
+xxxxxxxxxxxxxxx
+```
+
+A good chat prompt (better replace \n\n in xxx to \n, such that there will be no newlines in xxx):
+```
+User: hi
+
+Assistant: Hi. I am your assistant and I will provide expert full response in full details. Please feel free to ask any question and I will always answer it.
+
+User: xxx
+
+Assistant:
+```
+QA prompt (better replace \n\n in xxx to \n, such that there will be no newlines in xxx):
+```
+Question: xxx
+
+Answer:
+```
+and
+```
+Instruction: xxx
+
+Input: xxx
+
+Response:
+```