Oliver Wei
Oliver2021
AI & ML interests
None yet
Recent Activity
updated
a collection
3 days ago
Long context
updated
a collection
3 days ago
Long context
updated
a collection
3 days ago
Long context
Organizations
None yet
Collections
7
-
InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU
Paper • 2502.08910 • Published • 141 -
Cramming 1568 Tokens into a Single Vector and Back Again: Exploring the Limits of Embedding Space Capacity
Paper • 2502.13063 • Published • 62 -
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
Paper • 2502.11089 • Published • 134 -
LLM Pretraining with Continuous Concepts
Paper • 2502.08524 • Published • 27
models
None public yet
datasets
None public yet