johannhartmann
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -14,13 +14,15 @@ base_model:
|
|
14 |
- malteos/hermeo-7b
|
15 |
---
|
16 |
|
17 |
-
# Wiedervereinigung-7b-dpo
|
18 |
|
19 |
![image/png](https://huggingface.co/mayflowergmbh/Wiedervereinigung-7b/resolve/main/Wiedervereinigung-7b.png)
|
20 |
|
21 |
Some of the best german models with 7b parameters as an dare_ties merge.
|
|
|
22 |
Since the original models based on mistral - three of them on the brilliant german LeoLM/leo-mistral-hessianai-7b - they are reunited in this merged model.
|
23 |
Hence the name. To improve result quality they are dpo-trained with a german translation of oaast-dpo using our german fork of [LLaMA-Factory](https://github.com/mayflower/LLaMA-Factory).
|
|
|
24 |
|
25 |
Wiedervereinigung-7b itself is a [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing) merge of:
|
26 |
* [DiscoResearch/DiscoLM_German_7b_v1](https://huggingface.co/DiscoResearch/DiscoLM_German_7b_v1)
|
|
|
14 |
- malteos/hermeo-7b
|
15 |
---
|
16 |
|
17 |
+
# Wiedervereinigung-7b-dpo-laser
|
18 |
|
19 |
![image/png](https://huggingface.co/mayflowergmbh/Wiedervereinigung-7b/resolve/main/Wiedervereinigung-7b.png)
|
20 |
|
21 |
Some of the best german models with 7b parameters as an dare_ties merge.
|
22 |
+
|
23 |
Since the original models based on mistral - three of them on the brilliant german LeoLM/leo-mistral-hessianai-7b - they are reunited in this merged model.
|
24 |
Hence the name. To improve result quality they are dpo-trained with a german translation of oaast-dpo using our german fork of [LLaMA-Factory](https://github.com/mayflower/LLaMA-Factory).
|
25 |
+
After that this model got a [laserRMT](https://github.com/cognitivecomputations/laserRMT) treatment.
|
26 |
|
27 |
Wiedervereinigung-7b itself is a [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing) merge of:
|
28 |
* [DiscoResearch/DiscoLM_German_7b_v1](https://huggingface.co/DiscoResearch/DiscoLM_German_7b_v1)
|