BlinkDL commited on
Commit
02dfbd4
·
verified ·
1 Parent(s): 3176ebe

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -33,13 +33,13 @@ Use rwkv pip package 0.8.28+ for RWKV-7 inference: https://pypi.org/project/rwkv
33
 
34
  Evals and more information: https://www.rwkv.com/
35
 
36
- For developers: https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v7
37
 
38
  Chat demo: https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_CHAT.py
39
 
40
- MMLU rwkv7-v3-1b5 44.84% (rwkv6-v2.1-1b6 26.34%)
41
 
42
- MMLU eval: https://github.com/BlinkDL/RWKV-LM/blob/main/RWKV-v7/rwkv_mmlu_eval.py
43
 
44
  ## Model Description
45
 
 
33
 
34
  Evals and more information: https://www.rwkv.com/
35
 
36
+ For developers: https://github.com/BlinkDL/RWKV-LM
37
 
38
  Chat demo: https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_CHAT.py
39
 
40
+ MMLU rwkv7-v3-1b5 44.84% (rwkv6-v2.1-1b6 26.34%): https://github.com/BlinkDL/RWKV-LM/blob/main/RWKV-v7/rwkv_mmlu_eval.py
41
 
42
+ 0.1B = L12 D768 // 0.4B = L24 D1024 // 1.5B = L24 D2048 // ~3B = L32 D2560 // ~7B = L32 D4096
43
 
44
  ## Model Description
45