Create README.md

README.md

@@ -0,0 +1,53 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- transformers
+- safetensors
+- mistral
+- text-generation
+- arxiv:2304.12244
+- arxiv:2306.08568
+- arxiv:2308.09583
+- license:apache-2.0
+- autotrain_compatible
+- endpoints_compatible
+- text-generation-inference
+- region:us
+- text-generation
+model_name: WizardLM-2-8x22B-GGUF
+base_model: microsoft/WizardLM-2-7B
+inference: false
+model_creator: microsoft
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/WizardLM-2-8x22B-GGUF](https://huggingface.co/MaziyarPanahi/WizardLM-2-8x22B-GGUF)
+- Model creator: [microsoft](https://huggingface.co/microsoft)
+- Original model: [microsoft/WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B)
+
+## Description
+[MaziyarPanahi/WizardLM-2-7B-GGUF](https://huggingface.co/MaziyarPanahi/WizardLM-2-8x22B-GGUF) contains GGUF format model files for [microsoft/WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B).
+
+
+## Prompt template
+
+```
+{system_prompt}
+USER: {prompt}
+ASSISTANT: </s>
+```
+
+or
+
+```
+A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, 
+detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s>
+USER: {prompt} ASSISTANT: </s>......
+```