Update README.md
Browse files
README.md
CHANGED
@@ -99,8 +99,8 @@ It was created without group_size to lower VRAM requirements, and with --act-ord
|
|
99 |
|
100 |
* `gptq_model-4bit--1g.safetensors`
|
101 |
* Works with AutoGPTQ in CUDA or Triton modes.
|
102 |
-
* Works with GPTQ-for-LLaMa in CUDA mode. May have issues with GPTQ-for-LLaMa Triton mode.
|
103 |
* Works with text-generation-webui, including one-click-installers.
|
|
|
104 |
* Parameters: Groupsize = -1. Act Order / desc_act = True.
|
105 |
|
106 |
<!-- footer start -->
|
|
|
99 |
|
100 |
* `gptq_model-4bit--1g.safetensors`
|
101 |
* Works with AutoGPTQ in CUDA or Triton modes.
|
|
|
102 |
* Works with text-generation-webui, including one-click-installers.
|
103 |
+
* Does not work with GPTQ-for-LLaMa.
|
104 |
* Parameters: Groupsize = -1. Act Order / desc_act = True.
|
105 |
|
106 |
<!-- footer start -->
|