TheBloke
/

Llama-2-7B-Chat-GGML

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (17)

Quantize model

#43 opened about 2 months ago by

error loading model: unrecognized tensor type 10

#42 opened 4 months ago by

OSError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack

#41 opened 8 months ago by

swathiKonakanchi

Can't git clone repo's contents

#40 opened 8 months ago by

OSError: TheBloke/Llama-2-7B-Chat-GGML does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack.

#39 opened 8 months ago by

Program terminated while giving multiple request at a time

#38 opened 8 months ago by

Could not load Llama model from path

#37 opened 9 months ago by

How to configure with TGI?

#34 opened 10 months ago by

Add precise license metadata as part of Hacktoberfest 2023

#33 opened 11 months ago by

terminate called after throwing an instance of 'std::runtime_error' | what(): unexpectedly reached end of file | Aborted (core dumped)

#31 opened 11 months ago by

Traceback about ui_model_menu.py

#30 opened 11 months ago by

VLLM

#29 opened about 1 year ago by

Can you fine-tune Llama-2-7B-Chat-GGML and other quantized version of llama?

#28 opened about 1 year ago by

Tokenizer

#26 opened about 1 year ago by

Help to deploy it ??

#25 opened about 1 year ago by

[AUTOMATED] Model Memory Requirements

#24 opened about 1 year ago by

model-sizer-bot

Prompts for Question Answering Assistant

#21 opened about 1 year ago by

tokens

#20 opened about 1 year ago by

Why does llama-2-7b-chat.ggmlv3.q2_K.bin always load using Metal?

#19 opened about 1 year ago by

Model giving out weird responses

#18 opened about 1 year ago by

updated README.md on how to make changes

#17 opened about 1 year ago by

How to convert model into GGML format?

#13 opened about 1 year ago by

How to change model in config.yml file?

#12 opened about 1 year ago by

Tokenizer behaving differently than Meta's original.

#5 opened about 1 year ago by

Benchmark of different GGML version

#2 opened about 1 year ago by

aiapprentice101

Damn exciting this is!

#1 opened about 1 year ago by