Update README.md
Browse files
README.md
CHANGED
@@ -8,15 +8,29 @@ tags:
|
|
8 |
- unsloth
|
9 |
- llama
|
10 |
- trl
|
|
|
11 |
base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
|
|
|
|
|
12 |
---
|
13 |
|
14 |
-
# Uploaded model
|
15 |
-
|
16 |
- **Developed by:** Shekswess
|
17 |
- **License:** apache-2.0
|
18 |
- **Finetuned from model :** unsloth/llama-3-8b-Instruct-bnb-4bit
|
19 |
|
20 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
|
22 |
-
[
|
|
|
8 |
- unsloth
|
9 |
- llama
|
10 |
- trl
|
11 |
+
- medical
|
12 |
base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
|
13 |
+
datasets:
|
14 |
+
- Shekswess/medical_llama3_instruct_dataset_short
|
15 |
---
|
16 |
|
|
|
|
|
17 |
- **Developed by:** Shekswess
|
18 |
- **License:** apache-2.0
|
19 |
- **Finetuned from model :** unsloth/llama-3-8b-Instruct-bnb-4bit
|
20 |
|
21 |
+
To utilize the fine-tuning of the model, you need to use the gemma instruction prompt template for this medical version of the model:
|
22 |
+
```
|
23 |
+
<|start_header_id|>system<|end_header_id|> Answer the question truthfully, you are a medical professional.<|eot_id|><|start_header_id|>user<|end_header_id|> This is the question: {question}?<|eot_id|>
|
24 |
+
```
|
25 |
+
|
26 |
+
Metrics:
|
27 |
+
|
28 |
+
- train_runtime: 2083.0086
|
29 |
+
- train_samples_per_second: 0.96
|
30 |
+
- train_steps_per_second: 0.12
|
31 |
+
- total_flos: 2.928942377774285e+16
|
32 |
+
- train_loss: 1.228120258331299
|
33 |
+
- steps: 250
|
34 |
+
- epoch: 1.0
|
35 |
|
36 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6569f13004643352df96e40f/bEsUnq3XmpUSCMdOG-Ur1.png)
|