Hugging Face's logo

allenai
/
OLMoE-1B-7B-0924-Instruct-GGUF

GGUF
English
Mixture of Experts
olmo
olmoe
Inference Endpoints
conversational
Model card Files Community
1
shanearora commited on
Commit
d7c44e1
•
1 Parent(s): 9117583

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. olmoe-1b-7b-0924-instruct-f16.gguf +3 -0
  2. olmoe-1b-7b-0924-instruct-q2_k.gguf +3 -0
  3. olmoe-1b-7b-0924-instruct-q3_k_l.gguf +3 -0
  4. olmoe-1b-7b-0924-instruct-q3_k_m.gguf +3 -0
  5. olmoe-1b-7b-0924-instruct-q3_k_s.gguf +3 -0
  6. olmoe-1b-7b-0924-instruct-q4_0.gguf +3 -0
  7. olmoe-1b-7b-0924-instruct-q4_k_m.gguf +3 -0
  8. olmoe-1b-7b-0924-instruct-q4_k_s.gguf +3 -0
  9. olmoe-1b-7b-0924-instruct-q5_0.gguf +3 -0
  10. olmoe-1b-7b-0924-instruct-q5_k_m.gguf +3 -0
  11. olmoe-1b-7b-0924-instruct-q5_k_s.gguf +3 -0
  12. olmoe-1b-7b-0924-instruct-q6_k.gguf +3 -0
  13. olmoe-1b-7b-0924-instruct-q8_0.gguf +3 -0
olmoe-1b-7b-0924-instruct-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd310879bec683e61f793243ee033e3d5619e7103a6d8ca104986443ae71413b
3
+ size 13844566496
olmoe-1b-7b-0924-instruct-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30a594dcb82aedfa10af714cdd218717dc00de71b980e7bf35d18055f82ea525
3
+ size 2562763232
olmoe-1b-7b-0924-instruct-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69228ec3767eb58c93521413a2f8c376eaddea2d3a52fd6a885e709e9066be87
3
+ size 3611316704
olmoe-1b-7b-0924-instruct-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e589f85f43f619a7f4d8bbb3f5799dc268baebd4761b568a59002ef8033d7dc
3
+ size 3343929824
olmoe-1b-7b-0924-instruct-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e99875673941de26e5860e4b990e13ae414ef85bbe6e710ad8c0571ddef1a352
3
+ size 3023065568
olmoe-1b-7b-0924-instruct-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:361e8d83f0820e50d0ed1a13b10586ed9f476d99dcaf6aafd14f07e11840b22b
3
+ size 3928037856
olmoe-1b-7b-0924-instruct-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c310f1435a1222338fd2d3d974975be9cd908180b644bab0c2a94da1ac32f3f
3
+ size 4213512672
olmoe-1b-7b-0924-instruct-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:222aa205cf24fee28ff5a90b49b575b7e8935be9da8ba79ec650426f13e416d2
3
+ size 3963689440
olmoe-1b-7b-0924-instruct-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2908af3dc40657f11cb7493366e18699a766895a994c8872d919dbc3f67fee3
3
+ size 4779776480
olmoe-1b-7b-0924-instruct-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54dd9b00d9368a9f57ba3695e27456b6cf2e2e6085cc85ba6f757b58ace30dff
3
+ size 4926839264
olmoe-1b-7b-0924-instruct-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8432e700f10109ebb7801bedd60c03fb114a1d54aad38a8ba7a8ace92ef87aaf
3
+ size 4779776480
olmoe-1b-7b-0924-instruct-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec4687f2ad96fd7800512fb5c12105dcf4336db28f0363a54f1cb5b64ecd0045
3
+ size 5684748768
olmoe-1b-7b-0924-instruct-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d089e8b12dee00764c1783f6c557a2ddd1f680ffb0d22b44ad28ef25f8909c66
3
+ size 7359943136