Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding
Paper
•
2401.07851
•
Published
•
1
Heming Xia
hemingkx
AI & ML interests
Efficient and Effective NLP, Tool Learning, and Vision-Language Understanding.
Recent Activity
authored
a paper
about 3 hours ago
Unlocking Efficiency in Large Language Model Inference: A Comprehensive
Survey of Speculative Decoding
authored
a paper
about 3 hours ago
AppBench: Planning of Multiple APIs from Various APPs for Complex User
Instruction
authored
a paper
about 3 hours ago
SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference
Acceleration
Organizations
None yet
hemingkx's activity
authored
6
papers
about 3 hours ago
AppBench: Planning of Multiple APIs from Various APPs for Complex User Instruction
Paper
•
2410.19743
•
Published
•
1
SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
Paper
•
2410.06916
•
Published
Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation
Paper
•
2203.16487
•
Published
Can Large Multimodal Models Uncover Deep Semantics Behind Images?
Paper
•
2402.11281
•
Published
Enhancing Tool Retrieval with Iterative Feedback from Large Language Models
Paper
•
2406.17465
•
Published
updated
a
dataset
over 1 year ago