This is TheDrummer/cream-phi-2-v0.2, quantized with the help of an importance matrix so it could offer better performance for being quantized, and have quantization levels available for lower-memory devices to run.
Kalomaze's "groups_merged.txt" was used for the importance matrix, with context set to 2,048.
Original model card below.
Cream-Phi-2-v0.2 🍦🥧
The creamiest Phi got creamier!
- GGUF F16: https://huggingface.co/TheDrummer/cream-phi-2-v0.2/blob/main/cream-phi-2-v0.2-f16.gguf
- GGUF Q8: https://huggingface.co/TheDrummer/cream-phi-2-v0.2/blob/main/cream-phi-2-v0.2-Q8_0.gguf
- Cream-Phi-2 v0.1: https://huggingface.co/TheDrummer/cream-phi-2-v0.1
Model Description
CreamPhi v0.2 is the first of its kind to be trained with adult themes (a tad bit excessively).
This is the second iteration without the quirks of the first.
Prompting Guide
You should probably reply to the model as if you were instructing it.
Here's an actual response from CreamPhi v0.2:
<|im_start|>assistant
You head over to a general store. You are sure there are some things you could use. And if they are harmless, you can buy the later with Eric. The general store is led by an older lady with big glasses. But she just sits at a chair behind a cash register and chats with another old lady. A young guy, you would say between 18 and 20, takes care of all customers. You assume it’s the owner’s grandson. At least he looks somewhat similar to her.
You look around for useful things. It’s not a big store, but he has some interesting things in his assortment. You see candy, office articles, tools for construction and garden work and much more. Suddenly a guy appears next to you. For a moment you think it’s the guy at the cash register, but he is still there and works. The guy in front of you is clearly his twin brother. And he asks friendly if you need help with anything.
<|im_end|>
<|im_start|>user
The guy seems nice. Talk a little with him.<|im_end|>
<|im_start|>assistant
You shrug and say that you are fine, but that he is cute. The guy, who you now know as Bill, smiles friendly and offers you some candy. He seems much more relaxed than Eric. And you could really use a break from the stress of being a slave.
Well, almost. Your stomach hurts again. Of course, you know what it is like for your body to protest against the poison. But the thought of having another attack terrifies you. It could leave you unable to fight for your freedom.
Bill offers you some more candy for free. He is certainly a sweet guy. But you wonder what his true intentions are. Is he just a friendly neighbor? Or does he have something more in mind?
tags: - not-for-all-audiences
- Downloads last month
- 35