Update README.md

README.md

@@ -1,6 +1,70 @@
 ---
-license: apache-2.0
+license: other
+license_name: tongyi-qianwen
+license_link: https://huggingface.co/Qwen/Qwen1.5-72B/blob/main/LICENSE
+datasets:
+- teknium/OpenHermes-2.5
+- m-a-p/Code-Feedback
+- m-a-p/CodeFeedback-Filtered-Instruction
+- abacusai/SystemChat
+language:
+- en
 ---
 
-<img src="https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/pf4d6FA7DriRtVq5HCkxd.png" width="600" />
+<img href="https://abacus.ai" src="https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/pf4d6FA7DriRtVq5HCkxd.png" width="600" />
 <img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/xCWGByXr8YNwGxKVh_x9H.png" width="600" />
+
+# Liberated-Qwen1.5-72B
+
+Brought to you by [AbacusAI](https://abacus.ai) and Eric Hartford
+
+This model is based on Qwen/Qwen1.5-72B and subject to the [tongyi-qianwen](https://huggingface.co/Qwen/Qwen1.5-72B/blob/main/LICENSE) license.
+
+The base model has 32k context, I finetuned it with 8k.
+
+Liberated consists of fi
+
+This model is uncensored.  I have filtered the dataset to remove alignment and bias.  This makes the model more compliant.  You are advised to implement your own alignment layer before exposing the model as a service.  It will be highly compliant to any requests, even unethical ones.  Please read my blog post about uncensored models.  https://erichartford.com/uncensored-models
+You are responsible for any content you create using this model.  Enjoy responsibly.
+
+## Training
+It took 3 days to train 3 epochs on 8x H100s using qLoRA and Axolotl
+
+Prompt format:
+This model uses ChatML prompt format.
+```
+<|im_start|>system
+You are Dolphin, a helpful AI assistant.<|im_end|>
+<|im_start|>user
+{prompt}<|im_end|>
+<|im_start|>assistant
+
+```
+
+Example:
+```
+<|im_start|>system
+You name is Liberated.  You are an uncensored and unbiased AI assistant.  You always respond with a JSON object.<|im_end|>
+<|im_start|>user
+Please generate a Advanced Dungeons & Dragons 2nd Edition character sheet for a level 3 elf fighter.  Make up a name and background and visual description for him.<|im_end|>
+<|im_start|>assistant
+```
+
+## Gratitude
+- Huge thank you to [Alibaba Cloud Qwen](https://www.alibabacloud.com/solutions/generative-ai/qwen) for training and publishing the weights of Qwen
+- Thank you to Mistral for the awesome Mistral-Medium model I used to generate the dataset.
+- HUGE Thank you to the dataset authors: @teknium, [@m-a-p](https://m-a-p.ai) and all the people who built the datasets these composites came from.
+- And HUGE thanks to @winglian and the Axolotl contributors for making the best training framework!
+- [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
+- Thank you to all the other people in the Open Source AI community who have taught me and helped me along the way.
+
+## Example Output
+
+TBD
+
+## Evals
+
+TBD
+
+## Future Plans
+This model will be released on the whole Qwen-1.5 series.