Commit
·
acc2fc1
1
Parent(s):
456a1b9
add inference
Browse files
README.md
CHANGED
|
@@ -20,6 +20,12 @@ All details below are copied from the original repo.
|
|
| 20 |
Colab notebook for sharding: https://colab.research.google.com/drive/1f1q9qc56wzB_7-bjgNyLlO6f28ui1esQ
|
| 21 |
Colab notebook for inference (just change the model id): https://colab.research.google.com/drive/1zxwaTSvd6PSHbtyaoa7tfedAS31j_N6m
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
~
|
| 24 |
|
| 25 |
# **Llama 2**
|
|
|
|
| 20 |
Colab notebook for sharding: https://colab.research.google.com/drive/1f1q9qc56wzB_7-bjgNyLlO6f28ui1esQ
|
| 21 |
Colab notebook for inference (just change the model id): https://colab.research.google.com/drive/1zxwaTSvd6PSHbtyaoa7tfedAS31j_N6m
|
| 22 |
|
| 23 |
+
## Inference with Google Colab and HuggingFace 🤗
|
| 24 |
+
|
| 25 |
+
Get started by saving your own copy of this [fLlama_Inference notebook](https://colab.research.google.com/drive/1Ow5cQ0JNv-vXsT-apCceH6Na3b4L7JyW?usp=sharing).
|
| 26 |
+
|
| 27 |
+
You will be able to run inference using a free Colab notebook if you select a gpu runtime. See the notebook for more details.
|
| 28 |
+
|
| 29 |
~
|
| 30 |
|
| 31 |
# **Llama 2**
|