prithivMLmods commited on
Commit
edf2069
·
verified ·
1 Parent(s): f1bc9c5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -8,3 +8,7 @@ tags:
8
  ---
9
 
10
  ![30B.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/Yd7ju9VUxX91yc4MkNTSa.gif)
 
 
 
 
 
8
  ---
9
 
10
  ![30B.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/Yd7ju9VUxX91yc4MkNTSa.gif)
11
+
12
+ # **LwQ-30B-Instruct**
13
+
14
+ LwQ-30B-Instruct (Llama with Questions), based on the Llama 3.1 collection of multilingual large language models (LLMs), is a set of pre-trained and instruction-tuned generative models optimized for multilingual dialogue use cases. These models outperform many available open-source alternatives. **Model Architecture:** Llama 3.1 is an auto-regressive language model utilizing an optimized transformer architecture. The tuned versions undergo supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to better align with human preferences for helpfulness and safety. LwQ-30B is trained on synthetic reasoning datasets for mathematical reasoning and context-based problem-solving, with a focus on following instructions or keywords embedded in the input.