Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,7 @@ datasets:
|
|
12 |
- ruslanmv/ai-medical-chatbot
|
13 |
---
|
14 |
|
15 |
-
# Medical-Llama3-8B-GGUF
|
16 |
[![](future.jpg)](https://ruslanmv.com/)
|
17 |
This is a fine-tuned version of the Llama3 8B model, specifically designed to answer medical questions.
|
18 |
The model was trained on the AI Medical Chatbot dataset, which can be found at [ruslanmv/ai-medical-chatbot](https://huggingface.co/datasets/ruslanmv/ai-medical-chatbot). This fine-tuned model leverages the GGUF (General-Purpose Gradient-based Quantization with Uniform Forwarding) technique for efficient inference with 4-bit quantization.
|
@@ -34,7 +34,6 @@ The model was trained on the AI Medical Chatbot dataset, which can be found at [
|
|
34 |
1. **Install required Python libraries:**
|
35 |
|
36 |
|
37 |
-
|
38 |
```bash
|
39 |
# GPU llama-cpp-python
|
40 |
!CMAKE_ARGS="-DLLAMA_CUBLAS=on" FORCE_CMAKE=1 pip install llama-cpp-python --force-reinstall --upgrade --no-cache-dir --verbose
|
@@ -59,9 +58,7 @@ MODEL_PATH="/content/medical-llama3-8b.Q5_K_M.gguf"
|
|
59 |
```
|
60 |
|
61 |
|
62 |
-
|
63 |
-
|
64 |
-
Example of use
|
65 |
|
66 |
Here's an example of how to use the Medical-Llama3-8B-GGUF 4bit model to generate an answer to a medical question:
|
67 |
|
@@ -98,7 +95,7 @@ The output exmample
|
|
98 |
Hi, thank you for your query.
|
99 |
Hypothyroidism is characterized by fatigue, sensitivity to cold, weight gain, depression, hair loss and mental dullness. I would suggest that you get a complete blood count with thyroid profile including TSH (thyroid stimulating hormone), free thyroxine level, and anti-thyroglobulin antibodies. These tests will help in establishing the diagnosis of hypothyroidism.
|
100 |
If there is no family history of autoimmune disorders, then it might be due
|
101 |
-
|
102 |
|
103 |
|
104 |
## License
|
|
|
12 |
- ruslanmv/ai-medical-chatbot
|
13 |
---
|
14 |
|
15 |
+
# Medical-Llama3-8B-GGUF
|
16 |
[![](future.jpg)](https://ruslanmv.com/)
|
17 |
This is a fine-tuned version of the Llama3 8B model, specifically designed to answer medical questions.
|
18 |
The model was trained on the AI Medical Chatbot dataset, which can be found at [ruslanmv/ai-medical-chatbot](https://huggingface.co/datasets/ruslanmv/ai-medical-chatbot). This fine-tuned model leverages the GGUF (General-Purpose Gradient-based Quantization with Uniform Forwarding) technique for efficient inference with 4-bit quantization.
|
|
|
34 |
1. **Install required Python libraries:**
|
35 |
|
36 |
|
|
|
37 |
```bash
|
38 |
# GPU llama-cpp-python
|
39 |
!CMAKE_ARGS="-DLLAMA_CUBLAS=on" FORCE_CMAKE=1 pip install llama-cpp-python --force-reinstall --upgrade --no-cache-dir --verbose
|
|
|
58 |
```
|
59 |
|
60 |
|
61 |
+
## Example of use
|
|
|
|
|
62 |
|
63 |
Here's an example of how to use the Medical-Llama3-8B-GGUF 4bit model to generate an answer to a medical question:
|
64 |
|
|
|
95 |
Hi, thank you for your query.
|
96 |
Hypothyroidism is characterized by fatigue, sensitivity to cold, weight gain, depression, hair loss and mental dullness. I would suggest that you get a complete blood count with thyroid profile including TSH (thyroid stimulating hormone), free thyroxine level, and anti-thyroglobulin antibodies. These tests will help in establishing the diagnosis of hypothyroidism.
|
97 |
If there is no family history of autoimmune disorders, then it might be due
|
98 |
+
```
|
99 |
|
100 |
|
101 |
## License
|