Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,6 @@ tags:
|
|
| 14 |
---
|
| 15 |
# SmartLlama-3-Ko-8B-256k-PoSE
|
| 16 |
|
| 17 |
-
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 18 |
|
| 19 |
## Merge Details
|
| 20 |
### Merge Method
|
|
@@ -42,7 +41,7 @@ models:
|
|
| 42 |
- model: NousResearch/Meta-Llama-3-8B-Instruct
|
| 43 |
parameters:
|
| 44 |
density: 0.60
|
| 45 |
-
weight: 0.25
|
| 46 |
|
| 47 |
- model: winglian/llama-3-8b-256k-PoSE
|
| 48 |
parameters:
|
|
|
|
| 14 |
---
|
| 15 |
# SmartLlama-3-Ko-8B-256k-PoSE
|
| 16 |
|
|
|
|
| 17 |
|
| 18 |
## Merge Details
|
| 19 |
### Merge Method
|
|
|
|
| 41 |
- model: NousResearch/Meta-Llama-3-8B-Instruct
|
| 42 |
parameters:
|
| 43 |
density: 0.60
|
| 44 |
+
weight: 0.25
|
| 45 |
|
| 46 |
- model: winglian/llama-3-8b-256k-PoSE
|
| 47 |
parameters:
|