SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
Paper
โข
2502.02737
โข
Published
โข
193
Antonio Russo
Nioi
ยท
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
10 days ago
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language
Model
liked
a Space
14 days ago
agents-course/First_agent_template
reacted
to
TuringsSolutions's
post
with ๐
6 months ago
I developed a way to test very clearly whether or not a Transformers model can actually learn symbolic reasoning, or if LLM models are forever doomed to be offshoots of 'Socratic Parrots'. The results are in, undeniable proof that Transformers models CAN learn symbolic relationships. Undeniable proof that AI can learn its ABC's. Credit goes to myself, Claude, and ChatGPT. I would not be able to prove this without Claude or ChatGPT.
https://www.youtube.com/watch?v=I8jHRgahRfY
Organizations
Nioi's activity
upvoted
a
paper
10 days ago
liked
a
Space
14 days ago
reacted to
TuringsSolutions's
post with ๐
6 months ago
Post
2276
I developed a way to test very clearly whether or not a Transformers model can actually learn symbolic reasoning, or if LLM models are forever doomed to be offshoots of 'Socratic Parrots'. The results are in, undeniable proof that Transformers models CAN learn symbolic relationships. Undeniable proof that AI can learn its ABC's. Credit goes to myself, Claude, and ChatGPT. I would not be able to prove this without Claude or ChatGPT.
https://www.youtube.com/watch?v=I8jHRgahRfY
https://www.youtube.com/watch?v=I8jHRgahRfY
reacted to
Severian's
post with ๐
10 months ago
Post
3747
Create and Train Your Own Expert LLM: Generating Synthetic, Fact-Based Datasets with LMStudio/Ollama and then fine-tuning with MLX and Unsloth
Hey everyone!
I know there are tons of videos and tutorials out there already but I've noticed a lot of questions popping up in community posts about using synthetic datasets for creative projects and how to transform personal content into more factual material. In my own work doing enterprise-level SFT and crafting my open-source models, I've enhanced a Python framework originally shared by the creator of the Tess models. This improved stack utilizes local language models and also integrates the Wikipedia dataset to ensure that the content generated is as accurate and reliable as possible.
I've been thinking of putting together a comprehensive, step-by-step course/guide on creating your own Expert Language Model. From dataset preparation and training to deployment on Hugging Face and even using something like AnythingLLM for user interaction. I'll walk you through each phase, clarifying complex concepts and troubleshooting common pitfalls.
Let me know if this interests you!
Most of the datasets and models I've made have been using these scripts and my approach
Hey everyone!
I know there are tons of videos and tutorials out there already but I've noticed a lot of questions popping up in community posts about using synthetic datasets for creative projects and how to transform personal content into more factual material. In my own work doing enterprise-level SFT and crafting my open-source models, I've enhanced a Python framework originally shared by the creator of the Tess models. This improved stack utilizes local language models and also integrates the Wikipedia dataset to ensure that the content generated is as accurate and reliable as possible.
I've been thinking of putting together a comprehensive, step-by-step course/guide on creating your own Expert Language Model. From dataset preparation and training to deployment on Hugging Face and even using something like AnythingLLM for user interaction. I'll walk you through each phase, clarifying complex concepts and troubleshooting common pitfalls.
Let me know if this interests you!
Most of the datasets and models I've made have been using these scripts and my approach
- 16 replies
liked
a
model
11 months ago
liked
2
models
over 1 year ago
