Uploaded model

  • Developed by: tanquangduong
  • License: apache-2.0
  • Finetuned from model : unsloth/Qwen2.5-3B

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
77
Safetensors
Model size
3.09B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for tanquangduong/Qwen2.5-3B-DPO-TinyStories

Base model

Qwen/Qwen2.5-3B
Finetuned
unsloth/Qwen2.5-3B
Finetuned
(5)
this model
Quantizations
1 model