Aratako
/

Qwen1.5-MoE-2x72B

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Qwen1.5-MoE-2x72B / mergekit_moe_config.yml

Aratako

upload model

1210357 11 months ago

255 Bytes

	base_model: ./Qwen1.5-72B-Chat
	gate_mode: random
	dtype: bfloat16
	experts:
	- source_model: ./Qwen1.5-72B-Chat
	positive_prompts: []
	- source_model: ./Liberated-Qwen1.5-72B
	positive_prompts: []
	tokenizer_source: model:./Qwen1.5-72B-Chat