HuggingFaceH4
/

zephyr-orpo-141b-A35b-v0.1

Text Generation

Generated from Trainer

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

lewtun HF staff commited on Apr 18, 2024

Commit

55107ac

·

verified ·

1 Parent(s): af0fbbf

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -49,7 +49,7 @@ Zephyr 141B-A39B was trained to test the effectiveness of ORPO at scale and the
 | Model                                                                                               | MT Bench | IFEval |   BBH | AGIEval |
 |-----------------------------------------------------------------------------------------------------|---------:|-------:|------:|--------:|
-| [zephyr-orpo-141b-A39b-v0.1](https://huggingface.co/HuggingFaceH4/zephyr-orpo-141b-A39b-v0.1)       |     8.17 |  65.06 | 58.96 |   44.16 |
 | [databricks/dbrx-instruct](https://huggingface.co/databricks/dbrx-instruct)                         |     8.26 |  52.13 | 48.50 |   41.16 |
 | [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) |     8.30 |  55.08 | 45.31 |   47.68 |
@@ -67,7 +67,7 @@ from transformers import pipeline
 pipe = pipeline(
     "text-generation",
-    model="HuggingFaceH4/zephyr-orpo-141b-A39b-v0.1",
     device_map="auto",
     torch_dtype=torch.bfloat16,
 )

 | Model                                                                                               | MT Bench | IFEval |   BBH | AGIEval |
 |-----------------------------------------------------------------------------------------------------|---------:|-------:|------:|--------:|
+| [zephyr-orpo-141b-A39b-v0.1](https://huggingface.co/HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1)       |     8.17 |  65.06 | 58.96 |   44.16 |
 | [databricks/dbrx-instruct](https://huggingface.co/databricks/dbrx-instruct)                         |     8.26 |  52.13 | 48.50 |   41.16 |
 | [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) |     8.30 |  55.08 | 45.31 |   47.68 |
 pipe = pipeline(
     "text-generation",
+    model="HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1",
     device_map="auto",
     torch_dtype=torch.bfloat16,
 )