Commit
·
ebb4cdd
1
Parent(s):
24a7b71
Update README.md
Browse files
README.md
CHANGED
@@ -98,7 +98,7 @@ model = AutoModelForCausalLM.from_pretrained(model_id, load_in_8bit=True)
|
|
98 |
|
99 |
*Note*:
|
100 |
1) The model loading strategy above requires the [*bitsandbytes*](https://pypi.org/project/bitsandbytes/) and [*accelerate*](https://pypi.org/project/accelerate/) libraries
|
101 |
-
2) The Tokenizer, by default, adds at the beginning of the prompt the
|
102 |
|
103 |
## Evaluation
|
104 |
|
|
|
98 |
|
99 |
*Note*:
|
100 |
1) The model loading strategy above requires the [*bitsandbytes*](https://pypi.org/project/bitsandbytes/) and [*accelerate*](https://pypi.org/project/accelerate/) libraries
|
101 |
+
2) The Tokenizer, by default, adds at the beginning of the prompt the '\<BOS\>' token. If that is not the case, add as a starting token the *\<s\>* string.
|
102 |
|
103 |
## Evaluation
|
104 |
|