QLoRA Finetune Llama 3 Instruct 8B + OpenHermes 2.5

This model is based on Llama-3-8b, and is governed by META LLAMA 3 COMMUNITY LICENSE AGREEMENT

Llama 3 Instruct 8B 4-bit from unsloth, finetuned with the OpenHermes 2.5 dataset on my home PC on one 24GB 4090.

Special care was taken to preserve and reinforce proper eos token structure.

Safetensors

Model size

8.03B params

Tensor type

BF16

Inference Examples

Inference API (serverless) is not available, repository is disabled.

Model tree for yaystevek/llama-3-8b-Instruct-OpenHermes-2.5-QLoRA

Base model

Finetuned

this model

Quantizations