frhew commited on
Commit
896b6ce
1 Parent(s): 081ac4d

added prompt to model card

Browse files
Files changed (1) hide show
  1. README.md +20 -1
README.md CHANGED
@@ -71,7 +71,26 @@ Please check manually that your output text corresponds to the input text, as fa
71
 
72
  ## How to Get Started with the Model
73
 
74
- Use the code below to get started with the model.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75
 
76
  [More Information Needed]
77
 
 
71
 
72
  ## How to Get Started with the Model
73
 
74
+ We offer two tools to interact with our model: an online app and a browser extension. They can be viewed and used [here](https://publicinterest.ai/tool/simba?lang=en).
75
+
76
+ Alternatively, to load the model using transformers:
77
+
78
+ ```
79
+ from transformers import AutoTokenizer, AutoModelForCausalLM
80
+ import torch
81
+ device = "cuda"
82
+ tokenizer = AutoTokenizer.from_pretrained("hiig-piai/simba_best_092024")
83
+ model = AutoModelForCausalLM.from_pretrained("hiig-piai/simba_best_092024", torch_dtype=torch.float16).to(device)
84
+ ```
85
+
86
+ We used the following prompt at inference to test our model:
87
+
88
+ ```
89
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
90
+ Du bist ein hilfreicher Assistent und hilfst dem User, Texte besser zu verstehen.<|eot_id|><|start_header_id|>user<|end_header_id|>
91
+ Kannst du bitte den folgenden Text zusammenfassen und sprachlich auf ein A2-Niveau in Deutsch vereinfachen? Schreibe maximal 5 Sätze.
92
+ {input_text}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
93
+ ```
94
 
95
  [More Information Needed]
96