jingyeom commited on
Commit
a72ed11
1 Parent(s): 34022d4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+ ## Model
5
+ - base_model : yanolja/KoSOLAR-10.7B-v0.2
6
+ - training objective: instruction Tuning
7
+ ## Dataset
8
+ 공개 데이터 수집
9
+ - Deduplicating Training Data Makes Language Models Better 알고리즘 활용
10
+ - instruction version 1.4
11
+
12
+ ## Code
13
+ ```python
14
+ from transformers import AutoModelForCausalLM, AutoTokenizer
15
+ import torch
16
+
17
+ model_name = "jjingyeom/freeze_KoSoLAR-10.7B-v0.2_1.4_dedup_1"
18
+ model = AutoModelForCausalLM.from_pretrained(
19
+ model_name,
20
+ )
21
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
22
+ ```