ArthurConmyGDM
commited on
Commit
•
67b2a69
1
Parent(s):
92a14fb
Update README.md
Browse files
README.md
CHANGED
@@ -2,9 +2,16 @@
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
-
# 1.
|
6 |
|
7 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
8 |
|
9 |
# 2. What Is `gemmascope-2b-pt-res`?
|
10 |
|
@@ -12,27 +19,35 @@ Gemmascope is TODO
|
|
12 |
- `2b-pt-`: These SAEs were trained on Gemma v2 2B base model.
|
13 |
- `res`: These SAEs were trained on the model's residual stream.
|
14 |
|
15 |
-
|
16 |
-
|
17 |
-
Q1: Why does this model exist in `gg-hf`?
|
18 |
-
|
19 |
-
A1: See https://docs.google.com/document/d/1bKaOw2mJPJDYhgFQGGVOyBB3M4Bm_Q3PMrfQeqeYi0M (Google internal only).
|
20 |
-
|
21 |
-
Q2: What does "SAE" mean?
|
22 |
|
23 |
-
|
24 |
-
|
25 |
-
|
26 |
|
27 |
-
|
28 |
|
29 |
Point of contact: Arthur Conmy
|
30 |
|
31 |
Contact by email:
|
32 |
-
|
33 |
```python
|
34 |
''.join(list('moc.elgoog@ymnoc')[::-1])
|
35 |
```
|
36 |
|
37 |
HuggingFace account:
|
38 |
https://huggingface.co/ArthurConmyGDM
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
+
# 1. Gemma Scope
|
6 |
|
7 |
+
Gemma Scope is TODO
|
8 |
+
|
9 |
+
You can learn more about Gemma Scope from:
|
10 |
+
|
11 |
+
- Neuronpedia, an interactive external site hosting Gemma Scope: https://www.neuronpedia.org/gemma-scope
|
12 |
+
- Our official Google DeepMind blog post: TODO
|
13 |
+
- Our technical report: TODO (arxiv link here)
|
14 |
+
- A colab demo for Gemma Scope:
|
15 |
|
16 |
# 2. What Is `gemmascope-2b-pt-res`?
|
17 |
|
|
|
19 |
- `2b-pt-`: These SAEs were trained on Gemma v2 2B base model.
|
20 |
- `res`: These SAEs were trained on the model's residual stream.
|
21 |
|
22 |
+
# 3. Quick start
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
|
24 |
+
```python
|
25 |
+
# TODO(conmy): write code
|
26 |
+
```
|
27 |
|
28 |
+
# 4. Point of Contact
|
29 |
|
30 |
Point of contact: Arthur Conmy
|
31 |
|
32 |
Contact by email:
|
|
|
33 |
```python
|
34 |
''.join(list('moc.elgoog@ymnoc')[::-1])
|
35 |
```
|
36 |
|
37 |
HuggingFace account:
|
38 |
https://huggingface.co/ArthurConmyGDM
|
39 |
+
|
40 |
+
# 5. License
|
41 |
+
|
42 |
+
All software is licensed under the Apache License, Version 2.0 (Apache 2.0). You may not use this file except in compliance with the Apache 2.0 license. You may obtain a copy of the Apache 2.0 license at: https://www.apache.org/licenses/LICENSE-2.0.
|
43 |
+
|
44 |
+
|
45 |
+
All other materials are licensed under the terms of the Creative Commons Attribution 4.0 International License (CC BY). You may obtain a copy of the CC-BY license at: https://creativecommons.org/licenses/by/4.0/legalcode.
|
46 |
+
|
47 |
+
Unless required by applicable law or agreed to in writing, all software and materials distributed here under the Apache 2.0 or CC-BY licenses are distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the licenses for the specific language governing permissions and limitations under those licenses.
|
48 |
+
|
49 |
+
|
50 |
+
This is not an official Google product.
|
51 |
+
|
52 |
+
|
53 |
+
Copyright 2024 DeepMind Technologies Limited.
|