SPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training
Paper
•
2501.06842
•
Published
•
15
Lu Yin
Luuyin
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
17 days ago
SPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training
updated
a model
3 months ago
Luuyin/Test_model
updated
a model
4 months ago
Luuyin/1B_prenorm_50000
Organizations
None yet