Hugging Face's logo

mlx-community
/
QwQ-32B-Preview-6bit

Text Generation
Transformers
Safetensors
MLX
English
qwen2
chat
conversational
text-generation-inference
Inference Endpoints
6-bit
Model card Files Community
2

[WIP] Upload folder using huggingface_hub (multi-commit 44eac6fdde4ec098e31dc36f504e75906539b9febc2499716e67857b711ef2ab)

#1
by prince-canuma - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+21
-0
Files changed (7) hide show
  1. QwQ-32B-Preview-4bit/model-00001-of-00004.safetensors +3 -0
  2. QwQ-32B-Preview-4bit/model-00002-of-00004.safetensors +3 -0
  3. model-00001-of-00006.safetensors +3 -0
  4. model-00002-of-00006.safetensors +3 -0
  5. model-00003-of-00006.safetensors +3 -0
  6. model-00004-of-00006.safetensors +3 -0
  7. model-00005-of-00006.safetensors +3 -0
QwQ-32B-Preview-4bit/model-00001-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:420c69c59c28e61eff7874d12138a43b2dc90c3f0384e6f14c4a669e5de60a25
3
+ size 5366582717
QwQ-32B-Preview-4bit/model-00002-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:204f537ca473555f9d9785df40847b9550134fc41f5d79a05e68e2fe5b0e1686
3
+ size 5335712920
model-00001-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33a1860134825618e021cb6b2944621481e8ce30c978cf298083aee01cb91482
3
+ size 5271984219
model-00002-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a40a5a450736ddf08cd06e2e941774ae464618f72dea2dcc2562277cf67ce366
3
+ size 5316808338
model-00003-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e975d9bd965a5448ec40d6eb9b9ce7529fc5e8fa93c39be26bf7a818f970ac9
3
+ size 5265653525
model-00004-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fafdb2cf58d51fbc6f475f64546197c78d2aa3b3be6f451dbd5ee83fbda61a4
3
+ size 5265653515
model-00005-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a43b5b3c4116427ceaf9ff8dfbcf01c7cc174dcd3683a9860c1df112c7ef9d25
3
+ size 4869481681