What about results, loss on the same data?
Mario Zupan
mariozupan
·
AI & ML interests
None yet
Recent Activity
replied to
leonardlin's
post
8 days ago
My weekened project ended up being doing some testing between torchtune, axolotl, and unsloth. I *think* it's a 1:1 comparison of what LoRA fine-tuning performance looks like between the different hardware I have in my dev boxes (4090, 3090, 7900 XTX, W7900) with a few other interesting tidbits.
Tonight I wrote up a WandB report (the panel editor is super broken in Firefox 😔) that sums up some of the more interesting bits from the results: https://wandb.ai/augmxnt/train-bench/reports/torchtune-vs-axolotl-vs-unsloth-Trainer-Comparison--Vmlldzo4MzU3NTAx
liked
a model
about 2 months ago
WizardLMTeam/WizardMath-7B-V1.1
liked
a model
about 2 months ago
TheBloke/WizardMath-13B-V1.0-GGML
Organizations
None yet
mariozupan's activity
replied to
leonardlin's
post
8 days ago
liked
2
models
about 2 months ago
liked
a
model
6 months ago
liked
a
model
7 months ago
liked
a
model
9 months ago
liked
a
model
about 1 year ago
updated
a
model
over 1 year ago