Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,66 @@
|
|
1 |
---
|
|
|
|
|
|
|
|
|
2 |
license: unknown
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
inference: false
|
3 |
+
language:
|
4 |
+
- zh
|
5 |
+
- en
|
6 |
license: unknown
|
7 |
+
model_name: Chihiro-7B-v0.1
|
8 |
+
pipeline_tag: text-generation
|
9 |
+
prompt_template: '<s> SYS_PROMPT [INST] QUERY1 [/INST] RESPONSE1 [INST] QUERY2 [/INST]'
|
10 |
+
tags:
|
11 |
+
- nlp
|
12 |
+
- chinese
|
13 |
+
- mistral
|
14 |
+
- traditional_chinese
|
15 |
+
- merge
|
16 |
+
- mergekit
|
17 |
+
- MediaTek-Research/Breeze-7B-Instruct-v0_1
|
18 |
+
- mlabonne/Zebrafish-7B
|
19 |
---
|
20 |
+
|
21 |
+
<br/>
|
22 |
+
|
23 |
+
# 千尋 7B v0.1
|
24 |
+
|
25 |
+
Zebrafish 7B 加上 Breeze 7B 的 slerp merge 試驗性通用繁中基座模型 📚
|
26 |
+
|
27 |
+
GGUF Quants 👉 [Chihiro-7B-v0.1-GGUF](https://huggingface.co/yuuko-eth/Chihiro-7B-v0.1-GGUF)
|
28 |
+
|
29 |
+
請用 Mistral 7B Instruct 或是 Breeze 7B Instruct 所推薦的 Prompt 格式進行操作;以下為模型配置。
|
30 |
+
|
31 |
+
![](https://i.imgur.com/UwNO4fS.png)
|
32 |
+
|
33 |
+
### Chihiro 7B v0.1
|
34 |
+
|
35 |
+
This is an experimental Mistral-architecture SLERP merge with two brilliant base models. Zebrafish and Breeze were used together in this work.
|
36 |
+
|
37 |
+
Model configuration is as follows:
|
38 |
+
|
39 |
+
* [Breeze-7B-Instruct](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-v0_1) as base.
|
40 |
+
* [Zebrafish-7B](https://huggingface.co/mlabonne/Zebrafish-7B) as model 1.
|
41 |
+
|
42 |
+
To use the model, please use either prompt templates suggested by the base models, or just slap the Mistral one on.
|
43 |
+
|
44 |
+
<br/><br/>
|
45 |
+
|
46 |
+
### Benchmarks
|
47 |
+
|
48 |
+
Evaluation suite: OpenLLM
|
49 |
+
| Model | ARC |HellaSwag| MMLU |TruthfulQA|Winogrande|GSM8K|
|
50 |
+
|-------------------------------------------------------------------|----:|--------:|--------------------------|---------:|---------:|----:|
|
51 |
+
|[Chihiro-7B-v0.1](https://huggingface.co/yuuko-eth/Chihiro-7B-v0.1)|68.52| 85.95| (not yet evaluated) | 63.81| 81.77|64.22|
|
52 |
+
|
53 |
+
|
54 |
+
Evaluation suite: Nous
|
55 |
+
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
56 |
+
|-------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
57 |
+
|[Chihiro-7B-v0.1](https://huggingface.co/yuuko-eth/Chihiro-7B-v0.1)| 45.16| 75.26| 63.82| 47.38| 57.91|
|
58 |
+
|
59 |
+
|
60 |
+
Average: 47.38%
|
61 |
+
|
62 |
+
Average score: 57.91%
|
63 |
+
|
64 |
+
Evaluated Apr. 27, 2024, NVIDIA RTX 4090
|
65 |
+
|
66 |
+
<br/><br/>
|