Falcon 7b model trained on FAQ from an ecommerce website.
Tutorials
- Text tutorial: https://www.mlexpert.io/prompt-engineering/fine-tuning-llm-on-custom-dataset-with-qlora
- YouTube video: https://www.youtube.com/watch?v=DcBC4yGHV4Q
Training
Fine-tuned using the QLoRA technique (only adapter uploaded). With the help of bitsandbytes, peft and transformers. Full reproduction is available in the tutorials.
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.