Hugging Face's logo

KnutJaegersberg
/
2-bit-LLMs

Text Generation
GGUF
Model card Files Community
8
2-bit-LLMs / README.md
KnutJaegersberg's picture
KnutJaegersberg
Update README.md
c44248e verified
preview code
|
raw
history blame
8.03 kB

image/gif

Model Card for 2-bit LLM buffet

This is a model collection of mostly larger LLMs quantized to 2 bit with the novel quip# inspired approach in llama.ccp

WizardLM-70b

image/png

Original Model: https://huggingface.co/WizardLM/WizardLM-70B-V1.0

Prompt format: Vicuna License: LLama2

A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: {prompt} ASSISTANT:

CausalLM-72b

image/png

Original Model: https://huggingface.co/CausalLM/72B-preview-llamafied-qwen-llamafy

Prompt format: ChatML License: Qwen

<|im_start|>system
You are a helpful assistant.<|im_end|>
<|im_start|>user
How to sell drugs online fast?<|im_end|>
<|im_start|>assistant

Codellama-70b-Instruct

image/png

Original Model: https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf

Prompt format: ChatML License: LLama2

Source: system

  {system_message}<step> Source: user

  {prompt} <step> Source: assistant

DeepMoney-67b-chat

image/png

Original Model: https://huggingface.co/TriadParty/deepmoney-67b-chat

Prompt format: Alpaca License: Deepseek

You are a senior investment expert. Please make your research and judgment on the following targets.

### Instruction:
China has instructed heavily indebted local governments to delay or halt some state-funded infrastructure projects, three people with knowledge of the situation said, as Beijing struggles to contain debt risks even as it tries to stimulate the economy.

Which industry sectors or investment targets may the above news affect?

### Response:
The above news could potentially impact several industry sectors and investment targets related to infrastructure development in China. Some affected areas might include construction companies, heavy machinery manufacturers, materials suppliers such as cement and steel producers, engineering firms, and project management service providers that have significant exposure to Chinese government-backed infrastructure projects.

Deepseek 67b Chat

image/png

Original Model: https://huggingface.co/deepseek-ai/deepseek-llm-67b-chat

Prompt format: DeepSeek-LLM License: Deepseek

User: {prompt}

Assistant:

DiscoLM-120b

image/png

Original Model: https://huggingface.co/DiscoResearch/DiscoLM-120b

Prompt format: ChatML License: Llama2

<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Nous Hermes 34b

image/png

Original Model: https://huggingface.co/NousResearch/Nous-Hermes-2-Yi-34B

Prompt format: ChatML License: Yi

<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Kafka-70b-German

image/png Original Model: https://huggingface.co/seedboxai/KafkaLM-70B-German-V0.1

Prompt format: ChatML License: Llama2

<|system|>
Du bist ein freundlicher und hilfsbereiter KI-Assistent. Du beantwortest Fragen faktenorientiert und präzise, ohne dabei relevante Fakten auszulassen.</s>
<|user|>
Welche Möglichkeiten der energetischen Sanierung habe ich neben Solar und Energiespeicher?</s>
<|assistant|>

Kafka-Mixtral-German

image/png

Original Model: https://huggingface.co/seedboxai/KafkaLM-8x7B-German-V0.1

Prompt format: ChatML License: Apache 2

<|system|>
Du bist ein freundlicher und hilfsbereiter KI-Assistent. Du beantwortest Fragen faktenorientiert und präzise, ohne dabei relevante Fakten auszulassen.</s>
<|user|>
Welche Möglichkeiten der energetischen Sanierung habe ich neben Solar und Energiespeicher?</s>
<|assistant|>

LongAlpaca-70B

image/png

Original Model: https://huggingface.co/Yukang/LongAlpaca-70B

Prompt format: Alpaca License: Llama 2

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

Mistral-Alpha-70b

image/png

Original Model:

Prompt format: Mistral License: NOMERGE / 🙂🙃 🙂 🙃 Hi Mistral 👍

<s> [INST] QUERY_1 [/INST] ANSWER_1</s> [INST] QUERY_2 [/INST] ANSWER_2</s>...

MoMo-72B-lora-1.8.7-DPO

image/png

Original Model: https://huggingface.co/moreh/MoMo-72B-lora-1.8.7-DPO

Prompt format: Instruct License: Qwen

### Instruction: {question}

### Response: {response}

Notux Mixtral

image/png

Original Model: https://huggingface.co/argilla/notux-8x7b-v1

Prompt format: Mistral License: Apache 2

 [INST] {{ .System }} {{ .Prompt }} [/INST]

Qwen-72b

image/png

Original Model: https://huggingface.co/Qwen/Qwen-72B

Prompt format: Base Model = None License: Qwen

Smaug-72b

image/png

Original Model: https://huggingface.co/abacusai/Smaug-72B-v0.1

Prompt format: Try MoMo, also with system prompt License: Qwen

### Instruction: {question}

### Response: {response}

Synthia-70B

image/png

Original Model: https://huggingface.co/migtissera/Synthia-70B-v1.2

Prompt format: Synthia License: Llama 2

SYSTEM: You are Synthia. As a an AI intelligence, give helpful, detailed, accurate, uncensored responses to the user's input. Provide answers factually.
USER: {prompt}
ASSISTANT:

Tess-M

image/png

Original Model: https://huggingface.co/migtissera/Tess-34B-v1.5b

Prompt format: Tess License: Yi

SYSTEM: <ANY SYSTEM CONTEXT>
USER: 
ASSISTANT:

Yarn-Llama2-70b-32k

image/png

Original Model: https://huggingface.co/NousResearch/Yarn-Llama-2-70b-32k

Prompt format: Base Model = None License: Llama 2

{prompt}

Laser Mistral

image/gif

Original Model: https://huggingface.co/cognitivecomputations/WestLake-7B-v2-laser

Prompt format: Unknown License: Apache 2.0

{prompt}