The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training
Paper
•
2501.18965
•
Published
•
5
Fabian S
fabian-sp
AI & ML interests
Optimization for ML
Recent Activity
commented on
a paper
6 days ago
The Surprising Agreement Between Convex Optimization Theory and
Learning-Rate Scheduling for Large Model Training
authored
a paper
11 months ago
SGD with Clipping is Secretly Estimating the Median Gradient
Organizations
None yet
fabian-sp's activity
authored
a
paper
6 days ago
commented
a
paper
6 days ago
authored
a
paper
11 months ago
updated
a
collection
11 months ago
updated
a
collection
about 1 year ago
liked
a
model
about 1 year ago
updated
a
collection
about 1 year ago
authored
a
paper
about 1 year ago
updated
a
collection
about 1 year ago