Update README.md
Browse files
README.md
CHANGED
@@ -6,8 +6,12 @@ license: apache-2.0
|
|
6 |
|
7 |
An embedding model trained for study embedding quality vs model architecture (width/depth) given a size constraint (12M params).
|
8 |
|
9 |
-
- 2 layers
|
10 |
-
-
|
11 |
-
-
|
12 |
-
-
|
|
|
|
|
|
|
|
|
13 |
|
|
|
6 |
|
7 |
An embedding model trained for study embedding quality vs model architecture (width/depth) given a size constraint (12M params).
|
8 |
|
9 |
+
- **bo-emb-tiny-2-128**: 2 layers/hidden size 128/4.4m/[bert-tiny](https://huggingface.co/google/bert_uncased_L-2_H-128_A-2)
|
10 |
+
- **bo-emb-tiny-4-128**: 4 layers/H 128/4.8m
|
11 |
+
- **bo-emb-tiny-6-128**: 6 layers/H 128/5.2m
|
12 |
+
- **bo-emb-tiny-8-128**: 8 layers/H 128/5.6m
|
13 |
+
- **bo-emb-tiny-10-128**: 10 layers/H 128/6.0m
|
14 |
+
- **bo-emb-tiny-12-128**: 12 layers/H 128/6.4m
|
15 |
+
- **bo-emb-mini-2-256**: 2 layers/H 256/9.7m
|
16 |
+
- **bo-emb-mini-4-256**: 4 layers/H 256/11.3m
|
17 |
|