README.md

---
base_model: grimjim/kunoichi-lemon-royale-7B
library_name: transformers
quanted_by: grimjim
license: cc-by-nc-4.0
pipeline_tag: text-generation
---
# kunoichi-lemon-royale-7B-GGUF

This repo contains GGUF quantizations of [kunoichi-lemon-royale-7B](https://huggingface.co/grimjim/kunoichi-lemon-royale-7B).

Lightly tested with both Alpaca and ChatML prompts. Works with temperature 1.0 and minP 0.01, but feel free to vary it up. Tested to 8K context.

This model has a tendency to lean into revealing character interiority when generating narrative, which some people might find interesting. I found the model good with not only following the character card but also taking strong hints from the first message. Model is experimental and may occasionally misbehave.

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [SanjiWatsuki/Kunoichi-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-7B) as a base. Each of the models had strengths I liked to varying degrees, leading to weights and densities being adjusted in aesthetic proportion.

### Models Merged

The following models were included in the merge:
* [core-3/kuno-royale-v2-7b](https://huggingface.co/core-3/kuno-royale-v2-7b)
* [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
* [KatyTheCutie/LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: SanjiWatsuki/Kunoichi-7B
    # no parameters necessary for base model
  - model: KatyTheCutie/LemonadeRP-4.5.3
    parameters:
      weight: 0.3
      density: 0.4
  - model: core-3/kuno-royale-v2-7b
    parameters:
      weight: 0.3
      density: 0.4
  - model: SanjiWatsuki/Kunoichi-DPO-v2-7B
    parameters:
      weight: 0.4
      density: 0.8
merge_method: dare_ties
base_model: SanjiWatsuki/Kunoichi-7B
parameters:
  int8_mask: true
  normalize: true
dtype: bfloat16

```