unsloth
/

Llama-3.2-1B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

danielhanchen commited on 2 days ago

Commit

a433654

•

1 Parent(s): 9bb574b

Upload folder using huggingface_hub

Files changed (6) hide show

Llama-3.2-1B-Instruct-Q2_K.gguf +2 -2
Llama-3.2-1B-Instruct-Q3_K_M.gguf +2 -2
Llama-3.2-1B-Instruct-Q4_K_M.gguf +2 -2
Llama-3.2-1B-Instruct-Q5_K_M.gguf +2 -2
Llama-3.2-1B-Instruct-Q6_K.gguf +2 -2
Llama-3.2-1B-Instruct-Q8_0.gguf +2 -2

Llama-3.2-1B-Instruct-Q2_K.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:15d5fb6c43412de91579fd97ce63b550cf6c1c6c5e16c4643e27bb1ae5da5165
-size 575669056

 version https://git-lfs.github.com/spec/v1
+oid sha256:0a82c156af75195f853f416fde984db307ec7086f6d61e36986dbe0fa5bb7e0b
+size 580873888

Llama-3.2-1B-Instruct-Q3_K_M.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b2985522fd1938c53d9c9904133f78f9d3de471f45843635a50407b50a1eb756
-size 685638464

 version https://git-lfs.github.com/spec/v1
+oid sha256:01fe36d858ac02d3c5ead565a0d305834ba3f334d5d16b68f38ff41b91294bdf
+size 690843296

Llama-3.2-1B-Instruct-Q4_K_M.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:55bcfe29dd201753c2dc4ef7a99c6ab6ee1892314ae1aa750d25e5b3648402ac
-size 802489152

 version https://git-lfs.github.com/spec/v1
+oid sha256:29085f34fffc0fae853b3952418d691a3a5c039f8b3af6628c39dc86ae2a8d89
+size 807693984

Llama-3.2-1B-Instruct-Q5_K_M.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d7bda42be93f801d45a5e3c43280de4268d17b4474db6de287ea9441c48cd39b
-size 906298176

 version https://git-lfs.github.com/spec/v1
+oid sha256:5a751814d06f9b74cd937285e21366190a68e84cf8c7310ab19ecf80c4f6d5c7
+size 911503008

Llama-3.2-1B-Instruct-Q6_K.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8a5b0fc19dd27784ea9806992056d0afd66821853bb1ad4d7e9cefda9d0b5672
-size 1016595264

 version https://git-lfs.github.com/spec/v1
+oid sha256:e99afbf972b45de9de836f451c88be6709bc98caeea70ff0384cdb7252e3d392
+size 1021800096

Llama-3.2-1B-Instruct-Q8_0.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:eaaeacbd1d9240398f9a9fb4bf7f4ec8f273055d76fd1f386632d75c0ebcb887
-size 1315877696

 version https://git-lfs.github.com/spec/v1
+oid sha256:3f87a880027e7b9ea8e0da9e4009584336f352af444a0e6e5c20721ac4c7ffd1
+size 1321082528