bigscience
/

bloom-7b1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Younes Belkada commited on May 24, 2022

Commit

10367a6

•

1 Parent(s): f81113b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -60,7 +60,7 @@ Version 1.0 / 23.May.2022
 **Objective Function:** [Cross Entropy with mean reduction](https://pytorch.org/docs/stable/generated/torch.nn.CrossEntropyLoss.html#torch.nn.CrossEntropyLoss)
-**Number of Parameters:** 760M parameters; 24 layers, 16 attention heads
 #### **Infrastructure**

 **Objective Function:** [Cross Entropy with mean reduction](https://pytorch.org/docs/stable/generated/torch.nn.CrossEntropyLoss.html#torch.nn.CrossEntropyLoss)
+**Number of Parameters:** 6B3 parameters; 30 layers, 32 attention heads
 #### **Infrastructure**