Update README.md

README.md

@@ -1,3 +1,36 @@
 ---
 license: cc-by-sa-4.0
+language:
+- en
+library_name: transformers
+pipeline_tag: text-generation
+tags:
+- stableLM
+- sharded
 ---
+
+
+# StableLM-Base-Alpha: sharded checkpoint 
+
+This is a sharded checkpoint (with ~2GB shards) of the model. Refer to the [original model](https://huggingface.co/stabilityai/stablelm-base-alpha-3b) for all details.
+
+
+## Basic Usage
+
+
+install `transformers`, `accelerate`, and `bitsandbytes`.
+
+```bash
+pip install -U -q transformers bitsandbytes accelerate
+```
+
+Load the model in 8bit, then [run inference](https://huggingface.co/docs/transformers/generation_strategies#contrastive-search):
+
+```python
+from transformers import AutoTokenizer, AutoModelForCausalLM
+
+model_name = "ethzanalytics/stablelm-tuned-alpha-3b-sharded"
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+
+model = AutoModelForCausalLM.from_pretrained(model_name, load_in_8bit=True)
+```