license: cc-by-nc-4.0
language:
- en
tags:
- solar
- rotating-stack-merge
Skunk Ape 16b
This model is depricated. The 14b is a substantial improvement: https://huggingface.co/MarsupialAI/SkunkApe-14b
This model is a rotating-stack merge of three Solar-based models in a 16b (72 layer) configuration. The result of this "frankenmerge" is a medium-sized model that contains what I consider to be the best of the solar finetunes.
Mergefuel:
- Sao10K/Fimbulvetr-11B-v2
- Sao10K/Solstice-11B-v1
- TheDrummer/Moistral-11B-v1
This model is uncensored and capable of generating objectionable material. However, it is not an explicitely-NSFW model, and it has never "gone rogue" and tried to insert NSFW content into SFW prompts in my experience. As with any LLM, no factual claims made by the model should be taken at face value. You know that boilerplate safety disclaimer that most professional models have? Assume this has it too. This model is for entertainment purposes only.
iMatrix GGUFs: https://huggingface.co/MarsupialAI/SkunkApe-16b_iMatrix_GGUF
Sample output
{{[INPUT]}}
Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert.
{{[OUTPUT]}}
The sun was shining brightly on a warm summer afternoon, and all across the city the sound of joyful chirping birds echoed through the air. A young rabbit hopped out from his burrow to join the many creatures who lived in the woods in their usual fun-filled day. The rabbit was very excited; he was going to the big city today to see one of his favourite bands in the entire world perform live – Gwar! It wasn't every day he got to experience the heavy metal brutality and over-the-top spectacle that the alien reptile beasts brought to their shows. He put on a t-shirt announcing his love for them, grabbed his camera and headed off down the path from the safety of the woods towards the concrete jungle where the gig was going to happen.
He was so distracted by thoughts of the band that he never even noticed when he passed into the city limits. A short time later he found himself walking through the bustling streets of town, totally bewildered by everything around him. The rabbit had been to the city a couple of times before but never alone, and certainly not at this hour. His ears twitched nervously as he moved through crowds of loud, shouting, cursing human beings, feeling like an innocent creature lost in a nightmare. He tried to follow the banner advertising 'GWAR' in flashing red letters, weaving his way through the hurrying mob of humans.
When he reached the general area, a thick smell of exhaust fumes and vomit hit him. A few teenagers laughed at him, probably because he didn't belong. The rabbit's ears drooped sadly and he started to regret leaving the comforts of the woods, considering turning around and fleeing back home. But then he saw it: a seedy club lit up with neon signs and spray-pitted walls, perfect. It had a worn-out sign above the door announcing, 'The Pussy Melter'.
He swallowed hard, then scurried up the steps of the crumbling building's broken concrete stairs. Inside was a small lobby with a metal bar and some ripped vinyl seats. There were sticky spots everywhere from previous drunken revelers. The rabbit made his way up to the counter, breathing a sigh of relief when nobody shouted at or attacked him. He grinned proudly when the bored bartender nodded towards the entrance. "Show's in the back."
"Thanks," the rabbit chirped, handing over the five bucks the bartender wanted for the ticket.
"You're really pushing your lucksies, buddy," the bartender sneered. "There's a strict no-furry suit policy back there."
The rabbit blinked in confusion. A few other humans standing in line laughed. Furious, the little rabbit took out his camera, ready to take pictures if they dared hassle him. The bouncer snatched the camera away. "No pictures!" he barked. The rabbit opened his mouth to protest, but he changed his mind when he saw the big man's muscles. He reluctantly handed over his camera and stuffed it in his pocket. He crept inside the club feeling very vulnerable, leaving his fluffy tail in the rack by the door, not wanting to cause a scene.
<<<This goes on for a while. See sample.txt for full output>>>
Prompt format
Prefers alpaca.
WTF is a rotating-stack merge?
Inspired by Undi's experiments with stacked merges, Jeb Carter found that output quality and model initiative could be significantly improved by reversing the model order in the stack, and then doing a linear merge between the original and reversed stacks. That is what I did here. I created three passthrough stacked merges using the three source models (rotating the model order in each stack), and then doing a linear merge of all three stacks. The exact merge configs can be found in the recipe.txt file.