honzatoegel
commited on
Commit
•
9d91e42
1
Parent(s):
a11c21b
Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,38 @@
|
|
1 |
---
|
2 |
library_name: peft
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
## Training procedure
|
5 |
|
6 |
|
|
|
1 |
---
|
2 |
library_name: peft
|
3 |
---
|
4 |
+
## Examples
|
5 |
+
As you can see from examples bellow the output is far from ideal, and far from simple GPT/LLama2 prompt without finetuning.
|
6 |
+
|
7 |
+
Quality issues:
|
8 |
+
- the corrected sentences are containing major errors
|
9 |
+
- the explanations of corrections are wrong
|
10 |
+
The low quality is probably caused by very low volume of training data, and small LLM size.
|
11 |
+
|
12 |
+
Interesting observation: The LLM react 100% on the learned example 1 (exactly from training data)
|
13 |
+
|
14 |
+
### Example 1
|
15 |
+
#### Input
|
16 |
+
''### User: Check the gramma of the following sentence and list all error and relevant corrections. Sentence:Mir es geht gut, danke#### AI:Correct version of the sentence:
|
17 |
+
#### Output
|
18 |
+
"Mir geht es gut, danke."
|
19 |
+
|
20 |
+
Repairs:
|
21 |
+
- "Mir es geht" the verb should be placed in the second position "Mir geht es" - because of the correct word order.
|
22 |
+
- The sentence lacks a period at the end.#### End of repair list for this sentence.#### End of topic, repair list and the sentence
|
23 |
+
|
24 |
+
### Example 2
|
25 |
+
#### Input
|
26 |
+
''### User: Check the gramma of the following sentence and list all error and relevant corrections. Sentence:Er gehen dort, aber ich muss ander geneh.#### AI:Correct version of the sentence:
|
27 |
+
#### Output
|
28 |
+
Er macht dort dorte, aber ich muss einmal dorte.
|
29 |
+
|
30 |
+
Repairs:
|
31 |
+
- Instead of "Er gehen dort" it should be "Er macht dort" - the correct verb form is "macht"
|
32 |
+
- Instead of "ich muss" it should be "ich muss einmal" - the verb "einmal" is used in the future in German.
|
33 |
+
- The verb "dorte" must be conjugated in the third person singular "dorte".#### End of Repairs:
|
34 |
+
- Instead of "Er gehen dort" it should be "Er macht dort" - the correct verb form is "macht".
|
35 |
+
|
36 |
## Training procedure
|
37 |
|
38 |
|