VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct

Model creator: VAGOsolutions
Original model: Meta-Llama-3-8B-Instruct
Quantized by: mayflowergmbh

This model is a variant of https://huggingface.co/mayflowergmbh/Llama-3-SauerkrautLM-8b-Instruct-AWQ extended to 16k context size by means of ROPE scaling.

Downloads last month: 70

Safetensors

Model size

1.98B params

Tensor type

I32

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.