QuantFactory/llama3.1-airoboros3.2-QDT-8B-GGUF

This is quantized version of nbeerbower/llama3.1-airoboros3.2-QDT-8B created using llama.cpp

Original Model Card

llama3.1-airoboros3.2-QDT-8B

meta-llama/Meta-Llama-3.1-8B-Instruct finetuned on jondurbin/airoboros-3.2.

Llama 3 Instruct was used as the chat template.

Method

Finetuned using a Google Colab A100 for 1 epoch. Only 25% of the data was used for training due to limited resources, hence QDT (Quarter Data Test).

Based on mlabonne's SFT notebook.

Downloads last month
42
GGUF
Model size
8.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

Model tree for QuantFactory/llama3.1-airoboros3.2-QDT-8B-GGUF

Quantized
(335)
this model

Dataset used to train QuantFactory/llama3.1-airoboros3.2-QDT-8B-GGUF