Update README.md
Browse files
README.md
CHANGED
@@ -16,6 +16,7 @@ tags:
|
|
16 |
|
17 |
## νμΈ νλ κ°μ
|
18 |
- λμ λͺ¨λΈ : meta-llama/Llama-2-7b-hf
|
|
|
19 |
- νλ λ°©λ² : PEFT(Parameter Efficient Fine-Tuning) - LoRA(Low-Rank Adaptation of Large Language Models)
|
20 |
- κ΄λ ¨ λ
Όλ¬Έ : https://arxiv.org/abs/2106.09685
|
21 |
- Llama2 λͺ¨λΈμ νκ΅μ΄ μ±λ΄ λ°μ΄ν°(open korean instructions)μ μΌλΆλ₯Ό μ΄μ©νμ¬ νμΈ νλν λͺ¨λΈ
|
@@ -30,6 +31,7 @@ tags:
|
|
30 |
## νμΈ νλ μμΈ
|
31 |
|
32 |
- μνκ°μ 16μΌλ‘ μ€μ
|
|
|
33 |
```
|
34 |
peft_config = LoraConfig(
|
35 |
lora_alpha=16,
|
|
|
16 |
|
17 |
## νμΈ νλ κ°μ
|
18 |
- λμ λͺ¨λΈ : meta-llama/Llama-2-7b-hf
|
19 |
+
- λ°μ΄ν°μ
: heegyu/open-korean-instructions (10%)
|
20 |
- νλ λ°©λ² : PEFT(Parameter Efficient Fine-Tuning) - LoRA(Low-Rank Adaptation of Large Language Models)
|
21 |
- κ΄λ ¨ λ
Όλ¬Έ : https://arxiv.org/abs/2106.09685
|
22 |
- Llama2 λͺ¨λΈμ νκ΅μ΄ μ±λ΄ λ°μ΄ν°(open korean instructions)μ μΌλΆλ₯Ό μ΄μ©νμ¬ νμΈ νλν λͺ¨λΈ
|
|
|
31 |
## νμΈ νλ μμΈ
|
32 |
|
33 |
- μνκ°μ 16μΌλ‘ μ€μ
|
34 |
+
- r κ°μ 64λ‘ μ€μ (μ’ ν° λ―...γ
γ
)
|
35 |
```
|
36 |
peft_config = LoraConfig(
|
37 |
lora_alpha=16,
|