| license: other | |
| language: | |
| - en | |
| pipeline_tag: text-generation | |
| inference: false | |
| tags: | |
| - transformers | |
| - gguf | |
| - imatrix | |
| - pygmalion-2-7b | |
| Quantizations of https://huggingface.co/PygmalionAI/pygmalion-2-7b | |
| # From original readme | |
| ## Prompting | |
| The model has been trained on prompts using three different roles, which are denoted by the following tokens: `<|system|>`, `<|user|>` and `<|model|>`. | |
| The `<|system|>` prompt can be used to inject out-of-channel information behind the scenes, while the `<|user|>` prompt should be used to indicate user input. | |
| The `<|model|>` token should then be used to indicate that the model should generate a response. These tokens can happen multiple times and be chained up to | |
| form a conversation history. | |
| ### Prompting example | |
| The system prompt has been designed to allow the model to "enter" various modes and dictate the reply length. Here's an example: | |
| ``` | |
| <|system|>Enter RP mode. Pretend to be {{char}} whose persona follows: | |
| {{persona}} | |
| You shall reply to the user while staying in character, and generate long responses. | |
| ``` |