--- language: - en pipeline_tag: text-generation tags: - llama-cpp - AceInstruct-1.5B - gguf - Q8_0 - 1.5b - 8-bit - AceInstruct - llama-cpp - nvidia - code - math - chat - roleplay - text-generation - safetensors - nlp - code base_model: nvidia/AceInstruct-1.5B library_name: transformers --- # roleplaiapp/AceInstruct-1.5B-Q8_0-GGUF **Repo:** `roleplaiapp/AceInstruct-1.5B-Q8_0-GGUF` **Original Model:** `AceInstruct-1.5B` **Organization:** `nvidia` **Quantized File:** `aceinstruct-1.5b-q8_0.gguf` **Quantization:** `GGUF` **Quantization Method:** `Q8_0` **Use Imatrix:** `False` **Split Model:** `False` ## Overview This is an GGUF Q8_0 quantized version of [AceInstruct-1.5B](https://huggingface.co/nvidia/AceInstruct-1.5B). ## Quantization By I often have idle A100 GPUs while building/testing and training the RP app, so I put them to use quantizing models. I hope the community finds these quantizations useful. Andrew Webby @ [RolePlai](https://roleplai.app/)