Description

I reuploaded one of the smaller versions of this model originaly posted by TheBloke.

Original found here https://huggingface.co/TheBloke/SOLARC-MOE-10.7Bx4-GGUF

This repo contains GGUF format model files for Seungyoo Lee's Solarc MOE 10.7Bx4.

These files were quantised using hardware kindly provided by Massed Compute.

Downloads last month
8
GGUF
Model size
36.1B params
Architecture
llama

3-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for crystalkalem/SOLARC-MOE-10.7Bx4-GGUF

Quantized
(5)
this model