MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF · Discussions

Resources

View closed (3)

Interview request: genAI evaluation & documentation

#10 opened 6 months ago by

Add memory usage of each Quantization Methods

#9 opened 7 months ago by

cant deploy on inference endpoint

#8 opened 7 months ago by

Support for Function Calling?

#6 opened 9 months ago by

OSError: MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack.

#5 opened 9 months ago by

v3 tokenizer

#4 opened 9 months ago by

Can you please also quantize Phi-3-SMALL!!!

#2 opened 9 months ago by