Update README.md
Browse files
README.md
CHANGED
@@ -24,7 +24,7 @@ GGML files are for CPU inference using [llama.cpp](https://github.com/ggerganov/
|
|
24 |
|
25 |
* [4bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/h2ogpt-oasst1-512-30B-GPTQ).
|
26 |
* [4bit and 5bit GGML models for CPU inference](https://huggingface.co/TheBloke/h2ogpt-oasst1-512-30B-GGML).
|
27 |
-
* [float16 HF format unquantised model for GPU inference and further conversions](https://huggingface.co/TheBloke/h2ogpt-oasst1-512-30B-
|
28 |
|
29 |
## Provided files
|
30 |
| Name | Quant method | Bits | Size | RAM required | Use case |
|
|
|
24 |
|
25 |
* [4bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/h2ogpt-oasst1-512-30B-GPTQ).
|
26 |
* [4bit and 5bit GGML models for CPU inference](https://huggingface.co/TheBloke/h2ogpt-oasst1-512-30B-GGML).
|
27 |
+
* [float16 HF format unquantised model for GPU inference and further conversions](https://huggingface.co/TheBloke/h2ogpt-oasst1-512-30B-HF)
|
28 |
|
29 |
## Provided files
|
30 |
| Name | Quant method | Bits | Size | RAM required | Use case |
|