petkopetkov commited on
Commit
c932f67
·
verified ·
1 Parent(s): 8ac349d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -3
README.md CHANGED
@@ -2,6 +2,7 @@
2
  base_model: unsloth/SmolLM2-135M
3
  language:
4
  - en
 
5
  license: apache-2.0
6
  tags:
7
  - text-generation-inference
@@ -9,14 +10,52 @@ tags:
9
  - unsloth
10
  - llama
11
  - trl
 
 
 
 
 
 
 
 
12
  ---
13
 
14
- # Uploaded model
15
 
16
  - **Developed by:** petkopetkov
17
  - **License:** apache-2.0
18
  - **Finetuned from model :** unsloth/SmolLM2-135M
19
 
20
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  base_model: unsloth/SmolLM2-135M
3
  language:
4
  - en
5
+ - bg
6
  license: apache-2.0
7
  tags:
8
  - text-generation-inference
 
10
  - unsloth
11
  - llama
12
  - trl
13
+ datasets:
14
+ - petkopetkov/math_qa-bg
15
+ - petkopetkov/gsm8k-bg
16
+ - petkopetkov/winogrande_xl-bg
17
+ - petkopetkov/hellaswag-bg
18
+ - petkopetkov/mmlu-bg
19
+ - petkopetkov/arc-easy-bg
20
+ - petkopetkov/arc-challenge-bg
21
  ---
22
 
23
+ # SmolLM2-135M-Bulgarian
24
 
25
  - **Developed by:** petkopetkov
26
  - **License:** apache-2.0
27
  - **Finetuned from model :** unsloth/SmolLM2-135M
28
 
29
+ SmolLM2-135M finetuned on datasets translated to Bulgarian language:
30
 
31
+ - **MMLU**: multiple-choice questions from various branches of knowledge
32
+ - **Winogrande challenge**: testing world knowledge and understanding
33
+ - **Hellaswag**: testing sentence completion
34
+ - **ARC Easy/Challenge**: testing logical reasoning
35
+ - **GSM-8k**: solving multiple-choice questions in high-school mathematics
36
+ - **MathQA**: math word problems
37
+
38
+ ### Usage
39
+
40
+ First, install the Transformers library with:
41
+ ```sh
42
+ pip install -U transformers
43
+ ```
44
+
45
+ #### Run with the `pipeline` API
46
+
47
+ ```python
48
+ import torch
49
+ from transformers import pipeline
50
+
51
+ pipe = pipeline(
52
+ "text-generation",
53
+ model="petkopetkov/SmolLM2-135M-bg",
54
+ torch_dtype=torch.bfloat16,
55
+ device_map="auto"
56
+ )
57
+
58
+ prompt = "Колко е 2 + 2?"
59
+
60
+ print(pipe(prompt)[0]['generated_text'])
61
+ ```