Hugging Face's logo

mradermacher
/
Mistral-7B-Instruct-demi-merge-v0.2-7B-i1-GGUF

Transformers
GGUF
English
mergekit
Merge
Inference Endpoints
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
e9343dd
·
verified ·
1 Parent(s): 08e40e8

uploaded from nico1

Browse files
Files changed (25) hide show
  1. .gitattributes +24 -0
  2. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ1_M.gguf +3 -0
  3. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ1_S.gguf +3 -0
  4. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_M.gguf +3 -0
  5. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_S.gguf +3 -0
  6. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_XS.gguf +3 -0
  7. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_XXS.gguf +3 -0
  8. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_M.gguf +3 -0
  9. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_S.gguf +3 -0
  10. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_XS.gguf +3 -0
  11. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_XXS.gguf +3 -0
  12. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ4_NL.gguf +3 -0
  13. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ4_XS.gguf +3 -0
  14. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q2_K.gguf +3 -0
  15. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q2_K_S.gguf +3 -0
  16. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q3_K_L.gguf +3 -0
  17. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q3_K_M.gguf +3 -0
  18. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q3_K_S.gguf +3 -0
  19. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_0.gguf +3 -0
  20. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_1.gguf +3 -0
  21. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_K_M.gguf +3 -0
  22. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_K_S.gguf +3 -0
  23. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q5_K_M.gguf +3 -0
  24. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q5_K_S.gguf +3 -0
  25. Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60c170a0e39c6950c4ae827db6148e67d8f4503d1ca6de883a4aa7dc366f420d
3
+ size 1754447872
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:814d8f115f4728c3498d40bdbaed86b45790d80b4b709a779ff5e2016c6455c5
3
+ size 1612103680
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20f59b7e33722ab35f677203905d64af3c5209dfc3b46e53a0ff9400c1dea035
3
+ size 2500714496
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31c547fdbb0b6474d66176216bddd8b9c431ddfaf3c843e78f20a342c1828a0e
3
+ size 2310922240
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64f53da0c2f1212ab89a72203decebded2d72cbd7f1ddc26e4a2a127d20b8331
3
+ size 2198257664
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ab5cf8e65b94916c98caba7dd8f823985a754c1701db687e3356a105511ee9b
3
+ size 1991688192
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3a40f9199d3ac195c8bba0e3958f70b3c01d84c107080e6171c1a79a0234ad6
3
+ size 3284893696
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bf923499fe9e9e2e55d516a6c6d032a9662ad18009368e3c35028e4418242fe
3
+ size 3182395392
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eda68a601cfd6c0f1aef616ab8b5c41b78c72a1edadc08063e0d69dcf12c308a
3
+ size 3018817536
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d59bf43093d0b852524f0b61bf948be519416f9b93895b2310b5aed7b36e494
3
+ size 2827345920
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:113c5a18dcd1510361329bfbbafb8f2954b99604d570bdfe150092bbcf5689f4
3
+ size 4125696000
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:016f382430847b42cc1276d377d78b141c05f7a8587a77c517ae538344ddb447
3
+ size 3907690496
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd8552fafb45a96e33cf9de27cb7b90577995e19f602328412c03e3586c23e09
3
+ size 2719244288
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09262513d64e9ff52b26591db448a6535108be1b134949bd4ae2e52adb2c7c32
3
+ size 2528927744
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12d899d15dd013c6ee0b90cd358084c2cedfd6f17a1589409e9f06eb63cf9d4e
3
+ size 3822026752
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22fcf0f0abaf71d384933cb7ef168be9f113d376082117dc27cabaa7f11bf5fa
3
+ size 3518988288
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d045baa3e5d6a2c1f672da65eb042fd1b6aced46160978c61995d9adbf62d93
3
+ size 3164569600
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a3fb187c6e26c444256d5090007bf9e9ba2e0af9d07e28268e09d1f089fcf28
3
+ size 4123598848
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6855729dcd3d6f754e0d096df11ba18dd05f1ca1b5c6822de926cb40d02d8371
3
+ size 4553318400
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5bf1d5714506c83549737a1b29c1140c8bbaa962a7d0b779ac3bc58cee7de210
3
+ size 4368441344
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:125a8f269586b7057d996f536556278c9d1aa253f921493d1cca66950129280c
3
+ size 4140376064
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6487429c579e1ff220d33b733755feaa76f5afd29178aee20e9ae9322e5e145f
3
+ size 5131411456
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04261ed839755782df1bd014d437b50beffb7eb8dcbaefc0909a268b4486cd77
3
+ size 4997718016
Mistral-7B-Instruct-demi-merge-v0.2-7B.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:283f8d87317d2e187c41b06dc0e5a1cf2cdf1a62a7d7c1777dea976606b59355
3
+ size 5942067200