This is a finetuned model I have made using QLora (PEFT) with lora_r = 64 (help decide the matrice size where the weights will change) and lora_alpha = 16 (defines the intensity with which the lora will change the paramters) which are the majorly important hyperparameters of QLora which I learnt recently with the help of Krish Naik.

Downloads last month
0
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Dataset used to train shreeyans1298/Llama-2-7b-chat-finetune-health-chatbot