Alessandro Cauduro

alecauduro's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in mistralai/Mistral-Small-24B-Instruct-2501 4 days ago

Anybody got it to run a quantized version with vLLM

4

#24 opened 5 days ago by

alecauduro

New activity in casperhansen/mistral-small-24b-instruct-2501-awq 4 days ago

tekken.json from the original repo is missing and fails when running on vLLM

#2 opened 4 days ago by

alecauduro

New activity in unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit 5 days ago

How to run this version with vLLM

1

#2 opened 5 days ago by

alecauduro