Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This is the test version for pruning. This model is a base model that will be pruned and quantized for on-device purpose.

I used mergekit for merging two models:

https://github.com/cg123/mergekit The two models I combined are:

https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v2 https://huggingface.co/kyujinpy/Sakura-SOLAR-Instruct-DPO-v2

I used GGUF quantization.

Downloads last month
4
GGUF
Model size
10.7B params
Architecture
llama

2-bit

4-bit

Inference API
Unable to determine this model's library. Check the docs .