Cut Your Losses in Large-Vocabulary Language Models
Paper
•
2411.09009
•
Published
•
46
Ankit Sharma
nezubn
AI & ML interests
engineering • systems • ml
Recent Activity
liked
a model
about 2 months ago
deepseek-ai/DeepSeek-V3
liked
a model
3 months ago
bartowski/Llama-3.1_OpenScholar-8B-GGUF
upvoted
a
paper
3 months ago
Cut Your Losses in Large-Vocabulary Language Models
Organizations
nezubn's activity
upvoted
a
paper
3 months ago
upvoted
a
paper
4 months ago
upvoted
2
articles
7 months ago
Article
Optimizing your LLM in production
•
15
Article
Getting Started With Embeddings
•
55
upvoted
an
article
8 months ago
Article
quanto: a pytorch quantization toolkit
•
34
upvoted
2
papers
9 months ago
upvoted
a
paper
10 months ago
upvoted
an
article
11 months ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
•
119
upvoted
8
papers
11 months ago
Understanding LLMs: A Comprehensive Overview from Training to Inference
Paper
•
2401.02038
•
Published
•
63
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
Paper
•
2404.02258
•
Published
•
104
Advancing LLM Reasoning Generalists with Preference Trees
Paper
•
2404.02078
•
Published
•
44
Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs
Paper
•
2403.20041
•
Published
•
35
Jamba: A Hybrid Transformer-Mamba Language Model
Paper
•
2403.19887
•
Published
•
107
Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction
Paper
•
2403.18795
•
Published
•
20
Long-form factuality in large language models
Paper
•
2403.18802
•
Published
•
25
The case for 4-bit precision: k-bit Inference Scaling Laws
Paper
•
2212.09720
•
Published
•
3
upvoted
2
papers
12 months ago
upvoted
a
paper
about 1 year ago