YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

bits: 4,
group_size: 128,
desc_act: true,
static_groups: false,
sym: true,
lm_head: false,
damp_percent: 0.01,
true_sequential: true,
model_name_or_path: ,
model_file_base_name: model,
quant_method: gptq,
checkpoint_format: gptq,
meta:
quantizer: gptqmodel:0.9.9-dev0

Downloads last month: 4

Safetensors

Model size

261M params

Tensor type

BF16

I32

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.