Compressa-Embeddings / compressa-config.json
gmorgachev's picture
Upload folder using huggingface_hub
c2df24a verified
raw
history blame
197 Bytes
{
"model_name": "Compressa-Embeddings",
"torch_dtype": "torch.float16",
"device_map": "auto",
"trust_remote_code": false,
"backends": ["vllm"],
"config_class": "HFConfig"
}