mradermacher commited on
Commit
3167512
·
verified ·
1 Parent(s): cf02293

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +119 -0
README.md CHANGED
@@ -1,6 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  <!-- ### quantize_version: 2 -->
2
  <!-- ### output_tensor_quantised: 1 -->
3
  <!-- ### convert_type: hf -->
4
  <!-- ### vocab_type: -->
5
  <!-- ### tags: nicoboss -->
6
  weighted/imatrix quants of https://huggingface.co/Novaciano/BLAST_PROCESSING-3.2-1B
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Novaciano/BLAST_PROCESSING-3.2-1B
3
+ datasets:
4
+ - anthracite-org/kalo-opus-instruct-22k-no-refusal
5
+ - anthracite-org/stheno-filtered-v1.1
6
+ - anthracite-org/nopm_claude_writing_fixed
7
+ - AiAF/SCPWiki-Archive-02-March-2025-Datasets
8
+ - passing2961/multifaceted-skill-of-mind
9
+ - huihui-ai/QWQ-LONGCOT-500K
10
+ - huihui-ai/LONGCOT-Refine-500K
11
+ - Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned
12
+ - Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned
13
+ - alexandreteles/AlpacaToxicQA_ShareGPT
14
+ - Nitral-AI/Active_RP-ShareGPT
15
+ - PJMixers/hieunguyenminh_roleplay-deduped-ShareGPT
16
+ - Nitral-AI/RP_Alignment-ShareGPT
17
+ - Chaser-cz/sonnet35-charcard-roleplay-sharegpt
18
+ - AiCloser/sharegpt_cot_dataset
19
+ - PJMixers/Gryphe_Opus-WritingPrompts-Story2Prompt-ShareGPT
20
+ - priveeai/pippa_sharegpt
21
+ - Locutusque/sharegpt_gpt4_uncensored_cleaned
22
+ - OpenCoder-LLM/opc-sft-stage1
23
+ - OpenCoder-LLM/opc-sft-stage2
24
+ - microsoft/orca-agentinstruct-1M-v1
25
+ - microsoft/orca-math-word-problems-200k
26
+ - NousResearch/hermes-function-calling-v1
27
+ - AI-MO/NuminaMath-CoT
28
+ - AI-MO/NuminaMath-TIR
29
+ - allenai/tulu-3-sft-mixture
30
+ - cognitivecomputations/dolphin-coder
31
+ - HuggingFaceTB/smoltalk
32
+ - cognitivecomputations/samantha-data
33
+ - m-a-p/CodeFeedback-Filtered-Instruction
34
+ - m-a-p/Code-Feedback
35
+ - mlabonne/FineTome-100k
36
+ - PawanKrd/math-gpt-4o-200k
37
+ - V3N0M/Jenna-50K-Alpaca-Uncensored
38
+ - FreedomIntelligence/medical-o1-reasoning-SFT
39
+ language:
40
+ - es
41
+ - en
42
+ library_name: transformers
43
+ quantized_by: mradermacher
44
+ tags:
45
+ - transformers
46
+ - mergekit
47
+ - merge
48
+ - 1b
49
+ - rp
50
+ - nsfw
51
+ - roleplay
52
+ - español
53
+ - uncensored
54
+ - llama
55
+ - llama3.2
56
+ - not-for-all-audiences
57
+ ---
58
+ ## About
59
+
60
  <!-- ### quantize_version: 2 -->
61
  <!-- ### output_tensor_quantised: 1 -->
62
  <!-- ### convert_type: hf -->
63
  <!-- ### vocab_type: -->
64
  <!-- ### tags: nicoboss -->
65
  weighted/imatrix quants of https://huggingface.co/Novaciano/BLAST_PROCESSING-3.2-1B
66
+
67
+ <!-- provided-files -->
68
+ static quants are available at https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-GGUF
69
+ ## Usage
70
+
71
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
72
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
73
+ more details, including on how to concatenate multi-part files.
74
+
75
+ ## Provided Quants
76
+
77
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
78
+
79
+ | Link | Type | Size/GB | Notes |
80
+ |:-----|:-----|--------:|:------|
81
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
82
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
83
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
84
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
85
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
86
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
87
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
88
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
89
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
90
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
91
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
92
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
93
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
94
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
95
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
96
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
97
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
98
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
99
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
100
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
101
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | |
102
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
103
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
104
+ | [GGUF](https://huggingface.co/mradermacher/BLAST_PROCESSING-3.2-1B-i1-GGUF/resolve/main/BLAST_PROCESSING-3.2-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.3 | practically like static Q6_K |
105
+
106
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
107
+ types (lower is better):
108
+
109
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
110
+
111
+ And here are Artefact2's thoughts on the matter:
112
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
113
+
114
+ ## FAQ / Model Request
115
+
116
+ See https://huggingface.co/mradermacher/model_requests for some answers to
117
+ questions you might have and/or if you want some other model quantized.
118
+
119
+ ## Thanks
120
+
121
+ I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
122
+ me use its servers and providing upgrades to my workstation to enable
123
+ this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
124
+
125
+ <!-- end -->