pszemraj commited on
Commit
4b5764f
1 Parent(s): a2b265b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -17,9 +17,11 @@ tags:
17
  # dolly-v2-7b: **8-bit** sharded checkpoint
18
 
19
 
20
- This is a sharded checkpoint (with ~2GB shards) of the `databricks/dolly-v2-7b` model **in 8-bit precision using `bitsandbytes`**. Refer to the [original model](https://huggingface.co/databricks/dolly-v2-7b) for all details. For more info on loading 8bit models, refer to the [example repo](https://huggingface.co/ybelkada/bloom-1b7-8bit) and/or the `4.28.0` [release info](https://github.com/huggingface/transformers/releases/tag/v4.28.0).
21
 
22
- - total model size is only XX GB!
 
 
23
  - this enables low-RAM loading, i.e. Colab :)
24
 
25
  ## Basic Usage
 
17
  # dolly-v2-7b: **8-bit** sharded checkpoint
18
 
19
 
20
+ This is a sharded checkpoint (with ~2GB shards) of the `databricks/dolly-v2-7b` model **in 8-bit precision using `bitsandbytes`**.
21
 
22
+ Refer to the [original model](https://huggingface.co/databricks/dolly-v2-7b) for all details. For more info on loading 8bit models, refer to the [example repo](https://huggingface.co/ybelkada/bloom-1b7-8bit) and/or the `4.28.0` [release info](https://github.com/huggingface/transformers/releases/tag/v4.28.0).
23
+
24
+ - total model size is only ~7.5 GB!
25
  - this enables low-RAM loading, i.e. Colab :)
26
 
27
  ## Basic Usage