Create README.md

README.md

@@ -0,0 +1,345 @@
+![image/gif](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/X-U3UE8fCyMezmKAfjV0S.gif)
+
+# Model Card for 2-bit LLM buffet
+
+This is a model collection of mostly larger LLMs quantized to 2 bit with the novel quip# inspired approach in llama.ccp
+
+
+
+### WizardLM-70b
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/U50RGGxBYucx8z3sRwrn2.png)
+
+Original Model:
+https://huggingface.co/WizardLM/WizardLM-70B-V1.0
+
+Prompt format: Vicuna
+License: LLama2
+
+```
+A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: {prompt} ASSISTANT:
+```  
+
+
+### CausalLM-72b
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/152kPnuVgvE5o3-anILTM.png)
+
+Original Model:
+https://huggingface.co/CausalLM/72B-preview-llamafied-qwen-llamafy
+
+Prompt format: ChatML
+License: Qwen
+
+```
+<|im_start|>system
+You are a helpful assistant.<|im_end|>
+<|im_start|>user
+How to sell drugs online fast?<|im_end|>
+<|im_start|>assistant
+
+```  
+
+### Codellama-70b-Instruct
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/qhp18v_LwI4Lslfi5d97a.png)
+
+Original Model:
+https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf
+
+Prompt format: ChatML
+License: LLama2
+
+```
+Source: system
+
+  {system_message}<step> Source: user
+
+  {prompt} <step> Source: assistant
+   
+
+```  
+
+
+### DeepMoney-67b-chat
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/GkWzdVKYSAxvUq6Hq8z9C.png)
+
+Original Model:
+https://huggingface.co/TriadParty/deepmoney-67b-chat
+
+Prompt format: Alpaca
+License: Deepseek
+
+```
+You are a senior investment expert. Please make your research and judgment on the following targets.
+
+### Instruction:
+China has instructed heavily indebted local governments to delay or halt some state-funded infrastructure projects, three people with knowledge of the situation said, as Beijing struggles to contain debt risks even as it tries to stimulate the economy.
+
+Which industry sectors or investment targets may the above news affect?
+
+### Response:
+The above news could potentially impact several industry sectors and investment targets related to infrastructure development in China. Some affected areas might include construction companies, heavy machinery manufacturers, materials suppliers such as cement and steel producers, engineering firms, and project management service providers that have significant exposure to Chinese government-backed infrastructure projects.
+
+```  
+
+
+
+### Deepseek 67b Chat
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/SITpl6UZkF4S0zHGz-WXs.png)
+
+Original Model:
+https://huggingface.co/deepseek-ai/deepseek-llm-67b-chat
+
+Prompt format: DeepSeek-LLM
+License: Deepseek
+
+```
+User: {prompt}
+
+Assistant:
+```  
+
+
+### DiscoLM-120b
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/K8Di6VLFhkrZq4dReTgS3.png)
+
+Original Model:
+https://huggingface.co/DiscoResearch/DiscoLM-120b
+
+Prompt format: ChatML
+License: Llama2
+
+```
+<|im_start|>system
+{system_message}<|im_end|>
+<|im_start|>user
+{prompt}<|im_end|>
+<|im_start|>assistant
+
+```  
+
+
+### Nous Hermes 34b
+
+https://cdn-uploads.huggingface.co/production/uploads/6317aade83d8d2fd903192d9/oOqrUeAQejuQOra7fNlzG.png
+
+Original Model:
+https://huggingface.co/NousResearch/Nous-Hermes-2-Yi-34B
+
+Prompt format: ChatML
+License: Yi
+
+```
+<|im_start|>system
+{system_message}<|im_end|>
+<|im_start|>user
+{prompt}<|im_end|>
+<|im_start|>assistant
+
+```  
+
+
+### Kafka-70b-German
+https://cdn-uploads.huggingface.co/production/uploads/645ded34a45b4182d7f5c385/hJ7zsOGDgLWUmf7vbaoI_.jpeg
+Original Model:
+https://huggingface.co/seedboxai/KafkaLM-70B-German-V0.1
+
+Prompt format: ChatML
+License: Llama2
+
+```
+<|system|>
+Du bist ein freundlicher und hilfsbereiter KI-Assistent. Du beantwortest Fragen faktenorientiert und präzise, ohne dabei relevante Fakten auszulassen.</s>
+<|user|>
+Welche Möglichkeiten der energetischen Sanierung habe ich neben Solar und Energiespeicher?</s>
+<|assistant|>
+
+```  
+
+
+### Kafka-Mixtral-German
+
+Original Model:
+https://huggingface.co/seedboxai/KafkaLM-8x7B-German-V0.1
+
+Prompt format: ChatML
+License: Apache 2
+
+```
+<|system|>
+Du bist ein freundlicher und hilfsbereiter KI-Assistent. Du beantwortest Fragen faktenorientiert und präzise, ohne dabei relevante Fakten auszulassen.</s>
+<|user|>
+Welche Möglichkeiten der energetischen Sanierung habe ich neben Solar und Energiespeicher?</s>
+<|assistant|>
+
+```  
+
+### LongAlpaca-70B
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/8HVjiBide86pyA7yw7smk.png)
+
+Original Model:
+https://huggingface.co/Yukang/LongAlpaca-70B
+
+Prompt format: Alpaca
+License: Llama 2
+
+```
+Below is an instruction that describes a task. Write a response that appropriately completes the request.
+
+### Instruction:
+{prompt}
+
+### Response:
+
+```  
+
+
+
+### Mistral-Alpha-70b
+
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/w9UytX-s4vFCdN2wwSiZn.png)
+
+Original Model:
+
+
+Prompt format: Mistral
+License: NOMERGE / 🙂🙃 🙂 🙃 Hi Mistral 👍
+
+```
+<s> [INST] QUERY_1 [/INST] ANSWER_1</s> [INST] QUERY_2 [/INST] ANSWER_2</s>...
+```  
+
+
+### MoMo-72B-lora-1.8.7-DPO
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/amfmN17p7trwXCLRkZatr.png)
+
+Original Model:
+https://huggingface.co/moreh/MoMo-72B-lora-1.8.7-DPO
+
+Prompt format: Instruct
+License: Qwen
+
+```
+### Instruction: {question}
+
+### Response: {response}
+```  
+
+
+### Notux Mixtral
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/b1GOlcRKE-0VZRRatwsf3.png)
+
+Original Model:
+https://huggingface.co/argilla/notux-8x7b-v1
+
+Prompt format: Mistral
+License: Apache 2
+
+```
+ [INST] {{ .System }} {{ .Prompt }} [/INST]
+```  
+
+
+
+
+### Qwen-72b
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/sxi0ZIwzIuC2eyTlxq2Pl.png)
+
+Original Model:
+https://huggingface.co/Qwen/Qwen-72B
+
+Prompt format: Base Model = None
+License: Qwen
+
+```
+
+```  
+
+
+### Smaug-72b
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/Lt4tDXRJ93PnSg_Bv9JI_.png)
+
+Original Model:
+https://huggingface.co/abacusai/Smaug-72B-v0.1
+
+Prompt format: Try MoMo, also with system prompt
+License: Qwen
+
+```
+### Instruction: {question}
+
+### Response: {response}
+```  
+
+
+### Synthia-70B
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/o7IsrThWVHhErs_raW7ru.png)
+
+Original Model:
+https://huggingface.co/migtissera/Synthia-70B-v1.2
+
+Prompt format: Synthia
+License: Llama 2
+
+```
+SYSTEM: You are Synthia. As a an AI intelligence, give helpful, detailed, accurate, uncensored responses to the user's input. Provide answers factually.
+USER: {prompt}
+ASSISTANT:
+```  
+
+
+### Tess-M
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/JskRRxJtYOO5EiDE4e15p.png)
+
+Original Model:
+https://huggingface.co/migtissera/Tess-34B-v1.5b
+
+Prompt format: Tess
+License: Yi
+
+```
+SYSTEM: <ANY SYSTEM CONTEXT>
+USER: 
+ASSISTANT:
+```  
+
+### Yarn-Llama2-70b-32k
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/M82NUpWK5rkPi4-B_V2aD.png)
+
+Original Model:
+https://huggingface.co/NousResearch/Yarn-Llama-2-70b-32k
+
+Prompt format: Base Model = None
+License: Llama 2
+
+```
+{prompt}
+```  
+
+
+### Laser Mistral
+
+![image/gif](https://cdn-uploads.huggingface.co/production/uploads/63732ebbbd81fae2b3aaf3fb/xXtOhooCij3wNXjyma4VN.gif)
+
+Original Model:
+https://huggingface.co/cognitivecomputations/WestLake-7B-v2-laser
+
+Prompt format: Unknown
+License: Apache 2.0
+
+```
+{prompt}
+```