This contains the q4_0 GGML(ggjtv3) and GGUFv2 quantization of the model https://huggingface.co/acrastt/Bean-3B

Prompt template:

### HUMAN:
{prompt}

### RESPONSE:
<leave a newline for the model to answer>

Downloads last month: 50

GGUF

Model size

3.43B params

Architecture

llama

4-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Aryanne
/

Bean-3B-ggml-and-gguf

Dataset used to train Aryanne/Bean-3B-ggml-and-gguf