mehmetkeremturkcan
/

SmollerLM-20M-Instruct-Pruned-sft5-dpo3

Text Generation

Generated from Trainer

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

mehmetkeremturkcan commited on 6 days ago

Commit

6b7c0bf

·

verified ·

1 Parent(s): 78e2061

End of training

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -1,5 +1,6 @@
 ---
 base_model: mehmetkeremturkcan/SmollerLM-20M-Instruct-Pruned-sft5
 library_name: transformers
 model_name: SmollerLM-20M-Instruct-Pruned-sft5-dpo3
 tags:
@@ -11,7 +12,7 @@ licence: license
 # Model Card for SmollerLM-20M-Instruct-Pruned-sft5-dpo3
-This model is a fine-tuned version of [mehmetkeremturkcan/SmollerLM-20M-Instruct-Pruned-sft5](https://huggingface.co/mehmetkeremturkcan/SmollerLM-20M-Instruct-Pruned-sft5).
 It has been trained using [TRL](https://github.com/huggingface/trl).
 ## Quick start

 ---
 base_model: mehmetkeremturkcan/SmollerLM-20M-Instruct-Pruned-sft5
+datasets: trl-lib/ultrafeedback_binarized
 library_name: transformers
 model_name: SmollerLM-20M-Instruct-Pruned-sft5-dpo3
 tags:
 # Model Card for SmollerLM-20M-Instruct-Pruned-sft5-dpo3
+This model is a fine-tuned version of [mehmetkeremturkcan/SmollerLM-20M-Instruct-Pruned-sft5](https://huggingface.co/mehmetkeremturkcan/SmollerLM-20M-Instruct-Pruned-sft5) on the [trl-lib/ultrafeedback_binarized](https://huggingface.co/datasets/trl-lib/ultrafeedback_binarized) dataset.
 It has been trained using [TRL](https://github.com/huggingface/trl).
 ## Quick start