mlx-community
/

Violet-Lyra-Gutenberg-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Felladrin commited on 2 days ago

Commit

5ba96c8

·

verified ·

1 Parent(s): 1e91c72

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -8,9 +8,9 @@ tags:
 - mlx-my-repo
 ---
-# Felladrin/Violet-Lyra-Gutenberg-Q4-mlx
-The Model [Felladrin/Violet-Lyra-Gutenberg-Q4-mlx](https://huggingface.co/Felladrin/Violet-Lyra-Gutenberg-Q4-mlx) was converted to MLX format from [ohyeah1/Violet-Lyra-Gutenberg](https://huggingface.co/ohyeah1/Violet-Lyra-Gutenberg) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -21,7 +21,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Felladrin/Violet-Lyra-Gutenberg-Q4-mlx")
 prompt="hello"

 - mlx-my-repo
 ---
+# mlx-community/Violet-Lyra-Gutenberg-4bit
+The Model [mlx-community/Violet-Lyra-Gutenberg-4bit](https://huggingface.co/mlx-community/Violet-Lyra-Gutenberg-4bit) was converted to MLX format from [ohyeah1/Violet-Lyra-Gutenberg](https://huggingface.co/ohyeah1/Violet-Lyra-Gutenberg) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("mlx-community/Violet-Lyra-Gutenberg-4bit")
 prompt="hello"