adarksky/Qwen2.5-0.5B-sft-lora-rel-therapy
Text2Text Generation
•
Updated
Burning ray
adarksky
·
AI & ML interests
None yet
Recent Activity
updated
a model
3 days ago
adarksky/Qwen2.5-0.5B-sft-lora-rel-therapy
published
a model
4 days ago
adarksky/Qwen2.5-0.5B-sft-lora-rel-therapy
liked
a model
8 days ago
openai/whisper-tiny
Organizations
adarksky's activity
updated
a
model
3 days ago
published
a
model
4 days ago
liked
a
model
8 days ago
upvoted
a
paper
8 days ago
upvoted
a
paper
11 days ago
liked
a
model
12 days ago
liked
a
model
19 days ago
updated
a
model
23 days ago
Update kokoro.py
#43 opened 23 days ago
by
adarksky
liked
a
model
25 days ago
liked
a
model
about 1 month ago
reacted to
merve's
post with 🔥
2 months ago
Post
2675
small but mighty 🔥
you can fine-tune SmolVLM on an L4 with batch size of 4 and it will only take 16.4 GB VRAM 🫰🏻 also with gradient accumulation simulated batch size is 16 ✨
I made a notebook that includes all the goodies: QLoRA, gradient accumulation, gradient checkpointing with explanations on how they work 💝 https://github.com/huggingface/smollm/blob/main/finetuning/Smol_VLM_FT.ipynb
you can fine-tune SmolVLM on an L4 with batch size of 4 and it will only take 16.4 GB VRAM 🫰🏻 also with gradient accumulation simulated batch size is 16 ✨
I made a notebook that includes all the goodies: QLoRA, gradient accumulation, gradient checkpointing with explanations on how they work 💝 https://github.com/huggingface/smollm/blob/main/finetuning/Smol_VLM_FT.ipynb
liked
a
model
3 months ago
updated
a
model
3 months ago
liked
a
model
3 months ago
updated
a
model
3 months ago
liked
4
datasets
3 months ago