---
pipeline_tag: text-generation
inference: true
license: apache-2.0
datasets:
- simplescaling/s1K-1.1
base_model:
- Qwen/Qwen2.5-0.5B-Instruct
library_name: transformers
---

# Model Summary

> s1.1-0.5B is a sucessor of [s1](https://huggingface.co/2stacks/s1-0.5B) with better reasoning performance by leveraging reasoning traces from r1 instead of Gemini. This model was created simply to test the process used to train the original s1.1 cited below using consumer grade GPUs.

- **Logs:** https://wandb.ai/2stacks-sms/s1/runs/ishervdt?nw=nwuser2stacks
- **Repository:** [simplescaling/s1](https://github.com/simplescaling/s1)
- **Paper:** https://arxiv.org/abs/2501.19393

Thanks to [Ryan Marten](https://huggingface.co/ryanmarten) for helping generate r1 traces for s1K.

# Use

The model usage is documented [here](https://github.com/simplescaling/s1?tab=readme-ov-file#inference).