Update README.md
Browse files
README.md
CHANGED
@@ -12,6 +12,8 @@ license: gemma
|
|
12 |
|
13 |
# gemma2-9b-sahabatai-v1-instruct-BaseTIES
|
14 |
|
|
|
|
|
15 |
gemma2-9b-sahabatai-v1-instruct-BaseTIES is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
16 |
* [GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct](https://huggingface.co/GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct)
|
17 |
* [aisingapore/gemma2-9b-cpt-sea-lionv3-instruct](https://huggingface.co/aisingapore/gemma2-9b-cpt-sea-lionv3-instruct)
|
|
|
12 |
|
13 |
# gemma2-9b-sahabatai-v1-instruct-BaseTIES
|
14 |
|
15 |
+
Based on some research, when a finetuned model is merged with its base model with TIES method, there is possibility the merged model will achieve better output.
|
16 |
+
|
17 |
gemma2-9b-sahabatai-v1-instruct-BaseTIES is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
18 |
* [GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct](https://huggingface.co/GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct)
|
19 |
* [aisingapore/gemma2-9b-cpt-sea-lionv3-instruct](https://huggingface.co/aisingapore/gemma2-9b-cpt-sea-lionv3-instruct)
|