LoneStriker commited on
Commit
1e5fcb7
1 Parent(s): 0ce813b

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -1,35 +1,10 @@
1
- *.7z filter=lfs diff=lfs merge=lfs -text
2
- *.arrow filter=lfs diff=lfs merge=lfs -text
3
- *.bin filter=lfs diff=lfs merge=lfs -text
4
- *.bz2 filter=lfs diff=lfs merge=lfs -text
5
- *.ckpt filter=lfs diff=lfs merge=lfs -text
6
- *.ftz filter=lfs diff=lfs merge=lfs -text
7
- *.gz filter=lfs diff=lfs merge=lfs -text
8
- *.h5 filter=lfs diff=lfs merge=lfs -text
9
- *.joblib filter=lfs diff=lfs merge=lfs -text
10
- *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
- *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
- *.model filter=lfs diff=lfs merge=lfs -text
13
- *.msgpack filter=lfs diff=lfs merge=lfs -text
14
- *.npy filter=lfs diff=lfs merge=lfs -text
15
- *.npz filter=lfs diff=lfs merge=lfs -text
16
- *.onnx filter=lfs diff=lfs merge=lfs -text
17
- *.ot filter=lfs diff=lfs merge=lfs -text
18
- *.parquet filter=lfs diff=lfs merge=lfs -text
19
- *.pb filter=lfs diff=lfs merge=lfs -text
20
- *.pickle filter=lfs diff=lfs merge=lfs -text
21
- *.pkl filter=lfs diff=lfs merge=lfs -text
22
- *.pt filter=lfs diff=lfs merge=lfs -text
23
- *.pth filter=lfs diff=lfs merge=lfs -text
24
- *.rar filter=lfs diff=lfs merge=lfs -text
25
- *.safetensors filter=lfs diff=lfs merge=lfs -text
26
- saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
- *.tar.* filter=lfs diff=lfs merge=lfs -text
28
- *.tar filter=lfs diff=lfs merge=lfs -text
29
- *.tflite filter=lfs diff=lfs merge=lfs -text
30
- *.tgz filter=lfs diff=lfs merge=lfs -text
31
- *.wasm filter=lfs diff=lfs merge=lfs -text
32
- *.xz filter=lfs diff=lfs merge=lfs -text
33
- *.zip filter=lfs diff=lfs merge=lfs -text
34
- *.zst filter=lfs diff=lfs merge=lfs -text
35
- *tfevents* filter=lfs diff=lfs merge=lfs -text
 
1
+ 003.png filter=lfs diff=lfs merge=lfs -text
2
+ palmer-002.5-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
3
+ palmer-002.5-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
4
+ palmer-002.5-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
5
+ palmer-002.5-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
6
+ palmer-002.5-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
7
+ palmer-002.5-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
8
+ palmer-002.5-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
9
+ palmer-002.5-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
10
+ palmer-002.5-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
003.png ADDED

Git LFS Details

  • SHA256: a5229f1841c7da102dfd6fcb50dd3864cb884b647bdb9219588aee783584ea1f
  • Pointer size: 132 Bytes
  • Size of remote file: 1.23 MB
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ tags:
6
+ - merge
7
+ ---
8
+
9
+ Creative writing has never been so accesible, palmer goes beyond what it was thought about small language models. This model is a "MErging of Experts" (MEoE) using `palmer-002-2401` as base, biased as an assistant without using any prompts—as a result of these efforts—palmer is better than most 1b language models on most benchmarks, despite being sometimes 40% smaller than its counterparts.
10
+
11
+ ```
12
+ MMLU ARC-C OBQA HellaSwag PIQA Winogrande Average
13
+ tinyllama-chat | 0.2470 | 0.3285 | 0.3740 | 0.6037 | 0.7448 | 0.6022 | 0.4833 |
14
+ zyte-1b | 0.2397 | 0.3353 | 0.3700 | 0.6086 | 0.7541 | 0.5998 | 0.4845 |
15
+ palmer-002.5 | 0.2534 | 0.3370 | 0.3740 | 0.6128 | 0.7486 | 0.6535 | 0.4965 |
16
+ qwen-1-8 | 0.4536 | 0.3490 | 0.3320 | 0.5876 | 0.7307 | 0.5896 | 0.5070 |
17
+ ```
18
+
19
+ This work constitutes, given its compactness, an advancement towards SMLs, easily empowering edge devices such as mobile phones, raspberry pis and automated software/robots. Aditionally, palmer-002.5 deviates its main philosophy from palmer-family to become a more powerful model with more data instead of less.
20
+
21
+ ```
22
+ prompt: Reality is but
23
+ output: a dream,
24
+ And the dreams we make are our reality.
25
+
26
+ The world is a canvas, painted by our minds,
27
+ And we can make it a masterpiece.
28
+
29
+ So let us create, let us dream,
30
+ And let our imagination run wild.
31
+
32
+ For in our imagination lies our power,
33
+ To create a world that is truly our own.
34
+ ```
35
+
36
+ You can support me [through kofi](https://ko-fi.com/appvoid)
37
+
38
+ Note that since this model uses a transformer architecture as any popular language model, its output sometimes contains hallucinations (make mistakes or false statements), and as such, it must be used with caution on sensitive scenarios.
palmer-002.5-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc11596f4c73f8851e454e22ceb017dd7163255bdaea5feea48b4e351046e5f1
3
+ size 591526944
palmer-002.5-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19616a9444315c797d9455e2da80826f154d37ed0547be900e3ff8da1695ef8f
3
+ size 548404256
palmer-002.5-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca1282e5240025aabd928e82f4d63496dc0179ec81b949afe62d7897e3571a70
3
+ size 499342368
palmer-002.5-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8e7d768b4c7662a65eda4632bbc286df3ae9cc92990e32dc32b5cde34916f8e
3
+ size 667814944
palmer-002.5-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14a68a2df99bec72e07a99064abf50b89a5dc45ed13a111d9e65513bb0e4492c
3
+ size 639872032
palmer-002.5-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c39e7a9a4999353231f6189760e5121c83572480a3f9c9126ae3aa8e134270f1
3
+ size 782044192
palmer-002.5-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ecc0294d0ad240dd311b15cfc547233fa5b0bdb75d9d541dc3abf32bd4861ce
3
+ size 766028832
palmer-002.5-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32d3a50065dc59e3306460ab7a1dcd1d7a30449294c0244df0fe2afb0899b7b4
3
+ size 903412768
palmer-002.5-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b791862ca65f86dd8e7f5afc7d7ca98f85e60ab089660dceb34d6e15a4a14d22
3
+ size 1169808416