Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,11 @@
|
|
1 |
---
|
2 |
license: openrail
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: openrail
|
3 |
---
|
4 |
+
|
5 |
+
# miniSD-diff-loss-AD
|
6 |
+
|
7 |
+
This is motion module V2 fine-tuning experiment that tries two novel things.
|
8 |
+
|
9 |
+
One it uses miniSD as a base model when training. This leads to increased detail and clarity when generating. Two, it uses a loss function that ensures the frame diffs are similar between the target and predicted. This reduces high frequency movement, e.g. flicker.
|
10 |
+
|
11 |
+
The model might have some issues. It doesn't always produce as much motion as V2 and can require more steps for context blending.
|