MInference 1.0: 10x Faster Million Context Inference with a Single GPU
•
11
Yucheng
liyucheng
AI & ML interests
Robust LLMs Evaluation and Efficient LLMs Inference.
Articles
Organizations
Papers
2
spaces
1
datasets
27
liyucheng/long_paper_chunks
Viewer
•
Updated
•
368
•
36
liyucheng/mini_zh_news
Viewer
•
Updated
•
500
•
35
liyucheng/pg19-3k-long
Viewer
•
Updated
•
3k
•
42
liyucheng/pg19-4k
Viewer
•
Updated
•
4k
•
75
liyucheng/pg19
Viewer
•
Updated
•
13.6k
•
95
liyucheng/reject_sampling
Viewer
•
Updated
•
10
•
15
liyucheng/ShareGPT90K
Viewer
•
Updated
•
90.7k
•
154
•
2
liyucheng/mmlu_test
Viewer
•
Updated
•
14k
•
49
liyucheng/mmlu_train
Viewer
•
Updated
•
99.8k
•
40
liyucheng/ceval_all_dev
Viewer
•
Updated
•
520
•
35