Efficient Streaming Language Models with Attention Sinks
Paper
•
2309.17453
•
Published
•
13
Cool papers
-
-
Simple and Controllable Music Generation
Paper • 2306.05284 • Published • 147 -
FinGPT: Large Generative Models for a Small Language
Paper • 2311.05640 • Published • 28 -
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
Paper • 2305.07185 • Published • 9 -
Retentive Network: A Successor to Transformer for Large Language Models
Paper • 2307.08621 • Published • 171 -
Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
Paper • 2305.10973 • Published • 33 -
Fast Inference from Transformers via Speculative Decoding
Paper • 2211.17192 • Published • 4 -
GAIA: a benchmark for General AI Assistants
Paper • 2311.12983 • Published • 188 -
Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4
Paper • 2312.16171 • Published • 35