gmonsoon commited on
Commit
9d4ed55
·
verified ·
1 Parent(s): 4329608

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -12,6 +12,8 @@ license: gemma
12
 
13
  # gemma2-9b-sahabatai-v1-instruct-BaseTIES
14
 
 
 
15
  gemma2-9b-sahabatai-v1-instruct-BaseTIES is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
16
  * [GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct](https://huggingface.co/GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct)
17
  * [aisingapore/gemma2-9b-cpt-sea-lionv3-instruct](https://huggingface.co/aisingapore/gemma2-9b-cpt-sea-lionv3-instruct)
 
12
 
13
  # gemma2-9b-sahabatai-v1-instruct-BaseTIES
14
 
15
+ Based on some research, when a finetuned model is merged with its base model with TIES method, there is possibility the merged model will achieve better output.
16
+
17
  gemma2-9b-sahabatai-v1-instruct-BaseTIES is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
18
  * [GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct](https://huggingface.co/GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct)
19
  * [aisingapore/gemma2-9b-cpt-sea-lionv3-instruct](https://huggingface.co/aisingapore/gemma2-9b-cpt-sea-lionv3-instruct)