--- language: - en base_model: - mistralai/Mistral-Nemo-Base-2407 tags: - llama-cpp - Wayfarer-12B - gguf - Q3_K_L - 12B - 3-bit - Wayfarer - llama-cpp - LatitudeGames - code - math - chat - roleplay - text-generation - safetensors - nlp - code library_name: transformers pipeline_tag: text-generation --- # roleplaiapp/Wayfarer-12B-Q3_K_L-GGUF **Repo:** `roleplaiapp/Wayfarer-12B-Q3_K_L-GGUF` **Original Model:** `Wayfarer-12B` **Organization:** `LatitudeGames` **Quantized File:** `wayfarer-12b-q3_k_l.gguf` **Quantization:** `GGUF` **Quantization Method:** `Q3_K_L` **Use Imatrix:** `False` **Split Model:** `False` ## Overview This is an GGUF Q3_K_L quantized version of [Wayfarer-12B](https://huggingface.co/LatitudeGames/Wayfarer-12B). ## Quantization By I often have idle A100 GPUs while building/testing and training the RP app, so I put them to use quantizing models. I hope the community finds these quantizations useful. Andrew Webby @ [RolePlai](https://roleplai.app/)