beyoru commited on
Commit
88de83b
·
verified ·
1 Parent(s): 9458914

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -1
README.md CHANGED
@@ -9,4 +9,15 @@ language:
9
 
10
  Fine-tuning for function calling purpose
11
 
12
- (16, 512, qkvo, mlp)
 
 
 
 
 
 
 
 
 
 
 
 
9
 
10
  Fine-tuning for function calling purpose
11
 
12
+ (16, 512, qkvo, mlp)
13
+
14
+
15
+ ```
16
+ config = {
17
+ "rank": 16,
18
+ "alpha": 512,
19
+ "learning_rate": 2e-5,
20
+ "target_modules": ["attn", "mlps"]
21
+ }
22
+
23
+ ```