|
--- |
|
base_model: |
|
- DopeyGay/L3-Lunaris-Clouded-Vulca-8B |
|
- cognitivecomputations/dolphin-2.9-llama3-8b |
|
library_name: transformers |
|
tags: |
|
- mergekit |
|
- merge |
|
|
|
--- |
|
# VERY IMPORTANT: |
|
|
|
This model has not been tested or evaluated, and its performance, characteristics, and operational status are currently unknown. Feedback is appreciated. |
|
|
|
AI is a powerful tool, that being said, it may sometimes generate harmful, biased, untrue, or inappropriate content, and this model is no different. Please exercise caution and use it at your own risk, just like you would a drill, or a hammer, or any other tool |
|
# merge |
|
|
|
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). |
|
|
|
## Merge Details |
|
### Merge Method |
|
|
|
This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method. |
|
|
|
### Models Merged |
|
|
|
The following models were included in the merge: |
|
* [DopeyGay/L3-Lunaris-Clouded-Vulca-8B](https://huggingface.co/DopeyGay/L3-Lunaris-Clouded-Vulca-8B) |
|
* [cognitivecomputations/dolphin-2.9-llama3-8b](https://huggingface.co/cognitivecomputations/dolphin-2.9-llama3-8b) |
|
|
|
### Configuration |
|
|
|
The following YAML configuration was used to produce this model: |
|
|
|
```yaml |
|
models: |
|
- model: DopeyGay/L3-Lunaris-Clouded-Vulca-8B |
|
- model: cognitivecomputations/dolphin-2.9-llama3-8b |
|
merge_method: slerp |
|
base_model: DopeyGay/L3-Lunaris-Clouded-Vulca-8B |
|
dtype: bfloat16 |
|
parameters: |
|
t: [0, 0.25, 0.5, 1, 0.5, 0.25, 0] # Clouded-Vulca for input & output, dolphin-llama in the middle layers |
|
|
|
``` |
|
|
