yuuko-eth commited on
Commit
d48684e
1 Parent(s): 1c3915a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +63 -0
README.md CHANGED
@@ -1,3 +1,66 @@
1
  ---
 
 
 
 
2
  license: unknown
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ inference: false
3
+ language:
4
+ - zh
5
+ - en
6
  license: unknown
7
+ model_name: Chihiro-7B-v0.1
8
+ pipeline_tag: text-generation
9
+ prompt_template: '<s> SYS_PROMPT [INST] QUERY1 [/INST] RESPONSE1 [INST] QUERY2 [/INST]'
10
+ tags:
11
+ - nlp
12
+ - chinese
13
+ - mistral
14
+ - traditional_chinese
15
+ - merge
16
+ - mergekit
17
+ - MediaTek-Research/Breeze-7B-Instruct-v0_1
18
+ - mlabonne/Zebrafish-7B
19
  ---
20
+
21
+ <br/>
22
+
23
+ # 千尋 7B v0.1
24
+
25
+ Zebrafish 7B 加上 Breeze 7B 的 slerp merge 試驗性通用繁中基座模型 📚
26
+
27
+ GGUF Quants 👉 [Chihiro-7B-v0.1-GGUF](https://huggingface.co/yuuko-eth/Chihiro-7B-v0.1-GGUF)
28
+
29
+ 請用 Mistral 7B Instruct 或是 Breeze 7B Instruct 所推薦的 Prompt 格式進行操作;以下為模型配置。
30
+
31
+ ![](https://i.imgur.com/UwNO4fS.png)
32
+
33
+ ### Chihiro 7B v0.1
34
+
35
+ This is an experimental Mistral-architecture SLERP merge with two brilliant base models. Zebrafish and Breeze were used together in this work.
36
+
37
+ Model configuration is as follows:
38
+
39
+ * [Breeze-7B-Instruct](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-v0_1) as base.
40
+ * [Zebrafish-7B](https://huggingface.co/mlabonne/Zebrafish-7B) as model 1.
41
+
42
+ To use the model, please use either prompt templates suggested by the base models, or just slap the Mistral one on.
43
+
44
+ <br/><br/>
45
+
46
+ ### Benchmarks
47
+
48
+ Evaluation suite: OpenLLM
49
+ | Model | ARC |HellaSwag| MMLU |TruthfulQA|Winogrande|GSM8K|
50
+ |-------------------------------------------------------------------|----:|--------:|--------------------------|---------:|---------:|----:|
51
+ |[Chihiro-7B-v0.1](https://huggingface.co/yuuko-eth/Chihiro-7B-v0.1)|68.52| 85.95| (not yet evaluated) | 63.81| 81.77|64.22|
52
+
53
+
54
+ Evaluation suite: Nous
55
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
56
+ |-------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
57
+ |[Chihiro-7B-v0.1](https://huggingface.co/yuuko-eth/Chihiro-7B-v0.1)| 45.16| 75.26| 63.82| 47.38| 57.91|
58
+
59
+
60
+ Average: 47.38%
61
+
62
+ Average score: 57.91%
63
+
64
+ Evaluated Apr. 27, 2024, NVIDIA RTX 4090
65
+
66
+ <br/><br/>