-
ShortGPT: Layers in Large Language Models are More Redundant Than You Expect
Paper • 2403.03853 • Published • 61 -
SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
Paper • 2301.00774 • Published • 3 -
The LLM Surgeon
Paper • 2312.17244 • Published • 9 -
SliceGPT: Compress Large Language Models by Deleting Rows and Columns
Paper • 2401.15024 • Published • 69
Bui Van Hop
hllj
AI & ML interests
Computer Vision, Deep Learning, NLP
Organizations
Collections
16
-
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper • 2403.03507 • Published • 183 -
QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
Paper • 2309.14717 • Published • 44 -
ReFT: Representation Finetuning for Language Models
Paper • 2404.03592 • Published • 91
models
27
hllj/paligemma-3b-mix-224-vi-llava-checkpoint-10000
Updated
•
3
hllj/paligemma-3b-mix-224-vi-llava
Image-Text-to-Text
•
Updated
•
21
hllj/mistral-instruct-v0.2-awq-marlin
Text Generation
•
Updated
•
11
hllj/BloomZ-7B1-Vi-Math
Text Generation
•
Updated
•
14
hllj/Qwen-7B-Vi-Math
Text Generation
•
Updated
•
15
hllj/Zephyr-beta-7B-Vi-Math
Text Generation
•
Updated
•
19
hllj/Llama2-7B-Vi-Math
Text Generation
•
Updated
•
17
hllj/Mistral-7B-Vi-Math
Text Generation
•
Updated
•
16
hllj/sft-mistral-v1-clean-valid
Updated
•
7
hllj/sft-mistral-v2-clean-valid
Text Generation
•
Updated
•
27