Update README.md
Browse files
README.md
CHANGED
@@ -8,3 +8,7 @@ tags:
|
|
8 |
---
|
9 |
|
10 |
![30B.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/Yd7ju9VUxX91yc4MkNTSa.gif)
|
|
|
|
|
|
|
|
|
|
8 |
---
|
9 |
|
10 |
![30B.gif](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/Yd7ju9VUxX91yc4MkNTSa.gif)
|
11 |
+
|
12 |
+
# **LwQ-30B-Instruct**
|
13 |
+
|
14 |
+
LwQ-30B-Instruct (Llama with Questions), based on the Llama 3.1 collection of multilingual large language models (LLMs), is a set of pre-trained and instruction-tuned generative models optimized for multilingual dialogue use cases. These models outperform many available open-source alternatives. **Model Architecture:** Llama 3.1 is an auto-regressive language model utilizing an optimized transformer architecture. The tuned versions undergo supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to better align with human preferences for helpfulness and safety. LwQ-30B is trained on synthetic reasoning datasets for mathematical reasoning and context-based problem-solving, with a focus on following instructions or keywords embedded in the input.
|