joongi007
/

QI-neural-chat-7B-ko-DPO-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Original model is QuantumIntelligence/QI-neural-chat-7B-ko-DPO
quantized using llama.cpp

### System:
{System}

### User:
{User}

### Assistant:
{Assistant}

Downloads last month: 92

GGUF

Model size

7.24B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for joongi007/QI-neural-chat-7B-ko-DPO-GGUF

Base model

QuantumIntelligence/QI-neural-chat-7B-ko-DPO

Quantized

(2)

this model

Collection including joongi007/QI-neural-chat-7B-ko-DPO-GGUF

MY-GGUF

11 items • Updated Oct 7

Evaluation results

Metadata error: specify a dataset to view leaderboard