base_model: unsloth/mistral-7b-bnb-4bit | |
datasets: | |
- liyucheng/ShareGPT90K | |
language: | |
- en | |
license: apache-2.0 | |
tags: | |
- text-generation-inference | |
- transformers | |
- unsloth | |
- mistral | |
- trl | |
- LoRA | |
- LoRA Adapter | |
- PEFT | |
- ollama | |
# Uploaded model | |
- **Developed by:** pacozaa | |
- **License:** apache-2.0 | |
- **Finetuned from model :** unsloth/mistral-7b-bnb-4bit | |
- **This is LoRA Adapter :** Train with liyucheng/ShareGPT90K - the step of training is increasing over time since I am fine-tuning in Colab. Right now it's at 550 step. | |
# Ollama | |
- Model Page https://ollama.com/pacozaa/mistralsharegpt90 | |
- `ollama run pacozaa/mistralsharegpt90` | |
This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library. | |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth) |