Hao Zhang

zhisbug's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

authored 17 papers 25 days ago

LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers

Paper • 2310.03294 • Published Oct 5, 2023 • 2

Online Speculative Decoding

Paper • 2310.07177 • Published Oct 11, 2023 • 1

Judging LLM-as-a-judge with MT-Bench and Chatbot Arena

Paper • 2306.05685 • Published Jun 9, 2023 • 33

Evaluating the Robustness of Text-to-image Diffusion Models against Real-world Attacks

Paper • 2306.13103 • Published Jun 16, 2023 • 2

DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving

Paper • 2401.09670 • Published Jan 18, 2024

Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

Paper • 2402.02057 • Published Feb 3, 2024

Efficient Memory Management for Large Language Model Serving with PagedAttention

Paper • 2309.06180 • Published Sep 12, 2023 • 25

CLLMs: Consistency Large Language Models

Paper • 2403.00835 • Published Feb 28, 2024 • 3

Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

Paper • 2403.04132 • Published Mar 7, 2024 • 38

Toward Inference-optimal Mixture-of-Expert Large Language Models

Paper • 2404.02852 • Published Apr 3, 2024

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length

Paper • 2404.08801 • Published Apr 12, 2024 • 65

MPCFormer: fast, performant and private Transformer inference with MPC

Paper • 2211.01452 • Published Nov 2, 2022 • 1

Optimizing Speculative Decoding for Serving Large Language Models Using Goodput

Paper • 2406.14066 • Published Jun 20, 2024 • 1

AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models

Paper • 2406.13233 • Published Jun 19, 2024 • 1

Efficient LLM Scheduling by Learning to Rank

Paper • 2408.15792 • Published Aug 28, 2024 • 20

Specifications: The missing link to making the development of LLM systems an engineering discipline

Paper • 2412.05299 • Published Nov 25, 2024 • 1

Efficiently Serving LLM Reasoning Programs with Certaindex

Paper • 2412.20993 • Published 28 days ago • 35

upvoted a paper 26 days ago

Specifications: The missing link to making the development of LLM systems an engineering discipline

Paper • 2412.05299 • Published Nov 25, 2024 • 1

upvoted a paper 27 days ago

Efficiently Serving LLM Reasoning Programs with Certaindex

Paper • 2412.20993 • Published 28 days ago • 35

liked a dataset 3 months ago

LLM360/TxT360

Preview • Updated Nov 8, 2024 • 170k • 219