📟 Relay v0.1 (Mistral Nemo 2407): 8-bit (bnb)

This model page includes the 8-bit bitsandbytes version of relay-v0.1-Mistral-Nemo-2407. For more details about the model, and how it should be used, please see that model page.

Downloads last month: 5

Safetensors

Model size

12.2B params

Tensor type

F32

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Base model

mistralai/Mistral-Nemo-Base-2407

Finetuned

danlou/relay-v0.1-Mistral-Nemo-2407

Quantized

(4)

this model

Dataset used to train danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Collection including danlou/relay-v0.1-Mistral-Nemo-2407-8bit

📟 Relay

Collection

Turning base LLMs into IRCs, for more natural and versatile chat applications. • 5 items • Updated Dec 13, 2024