Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper
•
2312.00752
•
Published
•
140
Training
-
-
SparQ Attention: Bandwidth-Efficient LLM Inference
Paper • 2312.04985 • Published • 39 -
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Paper • 2402.00159 • Published • 62 -
Neural Network Diffusion
Paper • 2402.13144 • Published • 95 -
FuseChat: Knowledge Fusion of Chat Models
Paper • 2402.16107 • Published • 37 -
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper • 2402.17764 • Published • 607 -
ShortGPT: Layers in Large Language Models are More Redundant Than You Expect
Paper • 2403.03853 • Published • 62 -
meta-llama/Llama-3.1-8B
Text Generation • Updated • 917k • 1.31k