ruslanmv commited on
Commit
1150101
1 Parent(s): ceaaea0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -6
README.md CHANGED
@@ -12,7 +12,7 @@ datasets:
12
  - ruslanmv/ai-medical-chatbot
13
  ---
14
 
15
- # Medical-Llama3-8B-GGUF-8bit
16
  [![](future.jpg)](https://ruslanmv.com/)
17
  This is a fine-tuned version of the Llama3 8B model, specifically designed to answer medical questions.
18
  The model was trained on the AI Medical Chatbot dataset, which can be found at [ruslanmv/ai-medical-chatbot](https://huggingface.co/datasets/ruslanmv/ai-medical-chatbot). This fine-tuned model leverages the GGUF (General-Purpose Gradient-based Quantization with Uniform Forwarding) technique for efficient inference with 4-bit quantization.
@@ -34,7 +34,6 @@ The model was trained on the AI Medical Chatbot dataset, which can be found at [
34
  1. **Install required Python libraries:**
35
 
36
 
37
-
38
  ```bash
39
  # GPU llama-cpp-python
40
  !CMAKE_ARGS="-DLLAMA_CUBLAS=on" FORCE_CMAKE=1 pip install llama-cpp-python --force-reinstall --upgrade --no-cache-dir --verbose
@@ -59,9 +58,7 @@ MODEL_PATH="/content/medical-llama3-8b.Q5_K_M.gguf"
59
  ```
60
 
61
 
62
-
63
-
64
- Example of use
65
 
66
  Here's an example of how to use the Medical-Llama3-8B-GGUF 4bit model to generate an answer to a medical question:
67
 
@@ -98,7 +95,7 @@ The output exmample
98
  Hi, thank you for your query.
99
  Hypothyroidism is characterized by fatigue, sensitivity to cold, weight gain, depression, hair loss and mental dullness. I would suggest that you get a complete blood count with thyroid profile including TSH (thyroid stimulating hormone), free thyroxine level, and anti-thyroglobulin antibodies. These tests will help in establishing the diagnosis of hypothyroidism.
100
  If there is no family history of autoimmune disorders, then it might be due
101
- ``
102
 
103
 
104
  ## License
 
12
  - ruslanmv/ai-medical-chatbot
13
  ---
14
 
15
+ # Medical-Llama3-8B-GGUF
16
  [![](future.jpg)](https://ruslanmv.com/)
17
  This is a fine-tuned version of the Llama3 8B model, specifically designed to answer medical questions.
18
  The model was trained on the AI Medical Chatbot dataset, which can be found at [ruslanmv/ai-medical-chatbot](https://huggingface.co/datasets/ruslanmv/ai-medical-chatbot). This fine-tuned model leverages the GGUF (General-Purpose Gradient-based Quantization with Uniform Forwarding) technique for efficient inference with 4-bit quantization.
 
34
  1. **Install required Python libraries:**
35
 
36
 
 
37
  ```bash
38
  # GPU llama-cpp-python
39
  !CMAKE_ARGS="-DLLAMA_CUBLAS=on" FORCE_CMAKE=1 pip install llama-cpp-python --force-reinstall --upgrade --no-cache-dir --verbose
 
58
  ```
59
 
60
 
61
+ ## Example of use
 
 
62
 
63
  Here's an example of how to use the Medical-Llama3-8B-GGUF 4bit model to generate an answer to a medical question:
64
 
 
95
  Hi, thank you for your query.
96
  Hypothyroidism is characterized by fatigue, sensitivity to cold, weight gain, depression, hair loss and mental dullness. I would suggest that you get a complete blood count with thyroid profile including TSH (thyroid stimulating hormone), free thyroxine level, and anti-thyroglobulin antibodies. These tests will help in establishing the diagnosis of hypothyroidism.
97
  If there is no family history of autoimmune disorders, then it might be due
98
+ ```
99
 
100
 
101
  ## License