Hugging Face's logo

moot20
/
SmolVLM-256M-Instruct-MLX-8bits

Image-Text-to-Text
Transformers
Safetensors
MLX
English
idefics3
conversational
Inference Endpoints
Model card Files Community
SmolVLM-256M-Instruct-MLX-8bits / README.md
moot20's picture
moot20
Update README.md
a7f687b verified
preview code
|
raw
history blame contribute delete
771 Bytes
metadata
library_name: transformers
license: apache-2.0
datasets:
  - HuggingFaceM4/the_cauldron
  - HuggingFaceM4/Docmatix
pipeline_tag: image-text-to-text
language:
  - en
base_model:
  - HuggingFaceTB/SmolVLM-256M-Instruct
base_model_relation: quantized
tags:
  - mlx

moot20/SmolVLM-256M-Instruct-MLX-8bits

This model was converted to MLX format from HuggingFaceTB/SmolVLM-256M-Instruct using mlx-vlm version 0.1.12. Refer to the original model card for more details on the model.

Use with mlx 

pip install -U mlx-vlm

python -m mlx_vlm.generate --model moot20/SmolVLM-256M-Instruct-MLX-8bits --max-tokens 100 --temp 0.0 --prompt "Describe this image." --image <path_to_image>