metadata
license: other
Tim Dettmers' Guanaco 13B fp16 HF
These files are fp16 HF model files for Tim Dettmers' Guanaco 13B.
It is the result of merging the LoRA then saving in HF fp16 format.
Other repositories available
- 4-bit GPTQ models for GPU inference
- 4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference
- Merged, unquantised fp16 model in HF format
Want to support my work?
I've had a lot of people ask if they can contribute. I love providing models and helping people, but it is starting to rack up pretty big cloud computing bills.
So if you're able and willing to contribute, it'd be most gratefully received and will help me to keep providing models, and work on various AI projects.
Donaters will get priority support on any and all AI/LLM/model questions, and I'll gladly quantise any model you'd like to try.
- Patreon: coming soon! (just awaiting approval)
- Ko-Fi: https://ko-fi.com/TheBlokeAI
- Discord: https://discord.gg/UBgz4VXf
Original model card
Not provided by original model creator.