mwitiderrick
commited on
Commit
·
5d12f37
1
Parent(s):
a7d46ed
Update README.md
Browse files
README.md
CHANGED
@@ -124,7 +124,7 @@ model = KeyValueCacheInjector(model_path=os.path.dirname(input_file)).apply(mode
|
|
124 |
onnx.save(model, output_file)
|
125 |
print(f"Modified model saved to: {output_file}")
|
126 |
```
|
127 |
-
Follow the instructions on our [One Shot With SparseML]
|
128 |
## Slack
|
129 |
|
130 |
For further support, and discussions on these models and AI in general, join us at [Neural Magic's Slack server](https://join.slack.com/t/discuss-neuralmagic/shared_invite/zt-q1a1cnvo-YBoICSIw3L1dmQpjBeDurQ)
|
|
|
124 |
onnx.save(model, output_file)
|
125 |
print(f"Modified model saved to: {output_file}")
|
126 |
```
|
127 |
+
Follow the instructions on our [One Shot With SparseML](https://github.com/neuralmagic/sparseml/tree/main/src/sparseml/transformers/sparsification/obcq) guide for step-by-step instruction on performing one-shot quantization on your own large language models.
|
128 |
## Slack
|
129 |
|
130 |
For further support, and discussions on these models and AI in general, join us at [Neural Magic's Slack server](https://join.slack.com/t/discuss-neuralmagic/shared_invite/zt-q1a1cnvo-YBoICSIw3L1dmQpjBeDurQ)
|