Letemoin
/

llama_smurge_merged_AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

llama_smurge_merged_AWQ / mergekit_config.yml

Letemoin's picture

Create mergekit_config.yml

e5d54f9 verified 5 months ago

history blame contribute delete

221 Bytes

	slices:
	- sources:
	- model: ehristoforu/llama-3-12b-instruct
	layer_range: [0, 49]
	- sources:
	- model: jsfs11/Llama-3-RPMerge-8B-SLERP
	layer_range: [12, 32]
	merge_method: passthrough
	dtype: bfloat16