Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
proof of concept of a failed project
|
2 |
+
|
3 |
+
how you can load this into a diffusers-based notebook like [Doohickey](https://github.com/aicrumb/doohickey) might look something like this
|
4 |
+
|
5 |
+
```
|
6 |
+
from huggingface_hub import hf_hub_download
|
7 |
+
|
8 |
+
stable_inversion = "user/my-stable-inversion" #@param {type:"string"}
|
9 |
+
if len(stable_inversion)>1:
|
10 |
+
g = hf_hub_download(repo_id=stable_inversion, filename="token_embeddings.pt")
|
11 |
+
text_encoder.text_model.embeddings.token_embedding.weight = torch.load(g)
|
12 |
+
```
|
13 |
+
|
14 |
+
it was trained on 1024 images matching the 'genshin_impact' tag on safebooru, epochs 1 and 2 had the model being fed the full captions, epoch 3 had 50% of the tags in the caption, and epoch 4 had 25% of the tags in the caption. Learning rate was 1e-3 and the loss curve looked like this ![](https://pbs.twimg.com/media/FdsdivkWIBQYmZd?format=jpg&name=small)
|