rippertnt commited on
Commit
539a178
1 Parent(s): 43a2de6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -1,3 +1,17 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ datasets:
4
+ - Open-Orca/OpenOrca
5
+ language:
6
+ - en
7
+ library_name: transformers
8
+ pipeline_tag: text-generation
9
  ---
10
+ ![img](https://huggingface.co/circulus/Llama-2-13b-llava-v1/resolve/main/llava.jpg)
11
+
12
+ ```
13
+ model_name = "circulus/Llama-2-13b-llava-v1"
14
+ tokenizer = AutoTokenizer.from_pretrained(model_name, use_fast=False)
15
+ config = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_compute_dtype=torch.bfloat16, bnb_4bit_use_double_quant=True)
16
+ model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto", quantization_config=config)
17
+ ```