jfischoff commited on
Commit
8eb7790
·
1 Parent(s): 4ad9dcc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -1,3 +1,11 @@
1
  ---
2
  license: openrail
3
  ---
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: openrail
3
  ---
4
+
5
+ # miniSD-diff-loss-AD
6
+
7
+ This is motion module V2 fine-tuning experiment that tries two novel things.
8
+
9
+ One it uses miniSD as a base model when training. This leads to increased detail and clarity when generating. Two, it uses a loss function that ensures the frame diffs are similar between the target and predicted. This reduces high frequency movement, e.g. flicker.
10
+
11
+ The model might have some issues. It doesn't always produce as much motion as V2 and can require more steps for context blending.