morriszms commited on
Commit
492924e
·
verified ·
1 Parent(s): 7ec6159

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -1,16 +1,15 @@
1
  ---
2
- library_name: transformers
3
- license: apache-2.0
4
  language:
5
  - en
6
- pipeline_tag: text-generation
 
7
  tags:
8
- - safetensors
9
- - onnx
10
- - transformers.js
11
  - TensorBlock
12
  - GGUF
13
- base_model: HuggingFaceTB/SmolLM2-360M-Instruct
14
  ---
15
 
16
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -24,11 +23,11 @@ base_model: HuggingFaceTB/SmolLM2-360M-Instruct
24
  </div>
25
  </div>
26
 
27
- ## HuggingFaceTB/SmolLM2-360M-Instruct - GGUF
28
 
29
- This repo contains GGUF format model files for [HuggingFaceTB/SmolLM2-360M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-360M-Instruct).
30
 
31
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
32
 
33
  <div style="text-align: left; margin: 20px 0;">
34
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
1
  ---
2
+ base_model: unsloth/SmolLM2-360M-Instruct
 
3
  language:
4
  - en
5
+ library_name: transformers
6
+ license: apache-2.0
7
  tags:
8
+ - llama
9
+ - unsloth
10
+ - transformers
11
  - TensorBlock
12
  - GGUF
 
13
  ---
14
 
15
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
23
  </div>
24
  </div>
25
 
26
+ ## unsloth/SmolLM2-360M-Instruct - GGUF
27
 
28
+ This repo contains GGUF format model files for [unsloth/SmolLM2-360M-Instruct](https://huggingface.co/unsloth/SmolLM2-360M-Instruct).
29
 
30
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
31
 
32
  <div style="text-align: left; margin: 20px 0;">
33
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
SmolLM2-360M-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b237dc59a97b31c67fcfbd009c23273435806721c2144a02ef8b2386222e37ed
3
- size 218673856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0426e69276621295cd49cd69e879c35df02c52af6d3523ff4e8fad882874903
3
+ size 218675200
SmolLM2-360M-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cd49a8a2e565f450f1c89c5e10aa0d8ecc234d1447c9314bc4d3072e1665f5ec
3
- size 246321856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e960fe972a27748fc8babf237d86c7c7fb37bc1cc7ecb9c5dcff6de2114a3ba0
3
+ size 246323200
SmolLM2-360M-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:54f7ba9a6f6ac69533532b277a068f832ec78e331d9d46ef0836295866b61c8a
3
- size 234686656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:437b656afce506e038596e0929ed83c2760dc768aac4b663e0d68f5fbfe35f5e
3
+ size 234688000
SmolLM2-360M-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4e4f2ba5ce03cec05cf94bcb9038d9a75a524799df7ef8ae1daa06ba46f4058b
3
- size 218673856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc77ff507d509e04b5ea4a79b86c2cee19cc71d07d64bf5a8319fd2bd9598702
3
+ size 218675200
SmolLM2-360M-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1990575f3c67df6abed6ae0e43bed8c8f076ceaee5b3d9879b73272a5921b1c3
3
- size 229118656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8295b2cb25b3ca5d159e77108ff983dd16f1d397ce0778e96e8df3a78d2cbd2c
3
+ size 229120000
SmolLM2-360M-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:caec4cd9d527dadc4d91ab4a3eec5e05ff422ddbf7a0bddd322eac7b8fc145db
3
- size 270590656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4114d0d423d3badc3a13fc4d5bbb2b5598037d46bcd4a0b1651dc8287171ab82
3
+ size 270592000
SmolLM2-360M-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c9190f4f70fc94a7ccdb2f8e8b0dff4c60fb3246bbdaa0f0bb4b8a6804d525e8
3
- size 259915456
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ca64691d41ed26b47ffede78949f935b293d9370591da1bd55eab72f5e3f633
3
+ size 259916800
SmolLM2-360M-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a5f909b117d12e37fe4f6f138ad72172f5eda8be91ce3d696478a2b4b5de5e6
3
- size 268440256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ead3d35443911b056f8a75bc9dd196e689c937be951d3102c2b9bfe3788109d3
3
+ size 268441600
SmolLM2-360M-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:97725e95e4d19498f9c88c3b4f91a5fab0a787d33b7dc65fe33e2562331b2126
3
- size 289944256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64e56b4495330a3e568ef2a0ed6da2c748cf0cbda0ec45afe7a2f8f93e882b65
3
+ size 289945600
SmolLM2-360M-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c1c07befed2628613486e13fb62a1f21202ebf6b0b784a5fc5a2bcd0cafb9e91
3
- size 283185856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:232fb485b109f6d0846964c0beb8cf37da6a70b043293889fdd396972073d3a4
3
+ size 283187200
SmolLM2-360M-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:003b5c83222be26045d1488bfa13e45d2ffe4c513ee3399888a3864ac114bb76
3
- size 367358656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a34c316c785ebb25b95b69d0c956dd227aeb9feec4f6af7104569d39e22ec2b
3
+ size 367360000
SmolLM2-360M-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:27db7f7a3a950ab1fbd728362f24ba70cf49e1158bf99a1a9579eff95276adc8
3
- size 386405056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9188f4dd7bf8e54c8090b7906e57fc8c6323eff4f27557477453eec3f67437e1
3
+ size 386406400