metadata
license: apache-2.0
library_name: saelens
1. GemmaScope
Gemmascope is TODO
2. What Is gemmascope-9b-it-res
?
gemmascope-
: See 1.9b-it-
: These SAEs were trained on the Gemma v2 9B IT (instruction tuned) model (TODO link).res
: These SAEs were trained on the states on the residual stream.
3. GTM FAQ (TODO(conmy): delete for main rollout)
Q1: Why does this model exist in gg-hf
?
A1: See https://docs.google.com/document/d/1bKaOw2mJPJDYhgFQGGVOyBB3M4Bm_Q3PMrfQeqeYi0M (Google internal only).
Q2: What does "SAE" mean?
A2: Sparse Autoencoder. See https://docs.google.com/document/d/1roMgCPMPEQgaNbCu15CGo966xRLToulCBQUVKVGvcfM (should be available to trusted HuggingFace collaborators, and Google too).
TODO(conmy): remove this when making the main repo.
4. Point of Contact
Point of contact: Arthur Conmy
Contact by email:
''.join(list('moc.elgoog@ymnoc')[::-1])
HuggingFace account: https://huggingface.co/ArthurConmyGDM