QuantFactory Banner

QuantFactory/Chili_Dog_8B-GGUF

This is quantized version of FourOhFour/Chili_Dog_8B created using llama.cpp

Original Model Card

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: jeiku/fatgirlmagicv2
  - model: jeiku/magicfatgirlv2
merge_method: slerp
base_model: jeiku/fatgirlmagicv2
parameters:
  t:
   - value: 0.5
dtype: bfloat16
Downloads last month
38
GGUF
Model size
8.41B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Model tree for QuantFactory/Chili_Dog_8B-GGUF