Update README.md
Browse files
README.md
CHANGED
@@ -33,13 +33,13 @@ Use rwkv pip package 0.8.28+ for RWKV-7 inference: https://pypi.org/project/rwkv
|
|
33 |
|
34 |
Evals and more information: https://www.rwkv.com/
|
35 |
|
36 |
-
For developers: https://github.com/BlinkDL/RWKV-LM
|
37 |
|
38 |
Chat demo: https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_CHAT.py
|
39 |
|
40 |
-
MMLU rwkv7-v3-1b5 44.84% (rwkv6-v2.1-1b6 26.34%)
|
41 |
|
42 |
-
|
43 |
|
44 |
## Model Description
|
45 |
|
|
|
33 |
|
34 |
Evals and more information: https://www.rwkv.com/
|
35 |
|
36 |
+
For developers: https://github.com/BlinkDL/RWKV-LM
|
37 |
|
38 |
Chat demo: https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_CHAT.py
|
39 |
|
40 |
+
MMLU rwkv7-v3-1b5 44.84% (rwkv6-v2.1-1b6 26.34%): https://github.com/BlinkDL/RWKV-LM/blob/main/RWKV-v7/rwkv_mmlu_eval.py
|
41 |
|
42 |
+
0.1B = L12 D768 // 0.4B = L24 D1024 // 1.5B = L24 D2048 // ~3B = L32 D2560 // ~7B = L32 D4096
|
43 |
|
44 |
## Model Description
|
45 |
|