biomistral_ties

This model is the result of merge of the following models made with flow-merge:

  • Base model:
    • mistralai/Mistral-7B-Instruct-v0.1
  • Models:
    • BioMistral/BioMistral-Safetensors

flow-merge config

The following configuration was used to merge the models:

base_model: mistralai/Mistral-7B-Instruct-v0.1
models:
- path_or_id: mistralai/Mistral-7B-Instruct-v0.1
  weight: 0.5
- path_or_id: BioMistral/BioMistral-Safetensors
  weight: 0.5
method: ties-merging
method_global_parameters:
  scaling_coefficient: 0.7
  normalize: true
  top_k: 0.7
directory_settings:
  cache_dir: null
  local_dir: ./models
  output_dir: ./biomistral_ties
hf_hub_settings:
  trust_remote_code: false
Downloads last month
2
Safetensors
Model size
7.24B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.