sayakpaul HF staff commited on
Commit
6ea7c38
·
verified ·
1 Parent(s): bd48523

End of training

Browse files
README.md ADDED
@@ -0,0 +1,86 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: genmo/mochi-1-preview
3
+ library_name: diffusers
4
+ license: apache-2.0
5
+ instance_prompt: A pristine snowglobe featuring a winter scene sits peacefully. The
6
+ globe violently explodes, sending glass, water, and glittering fake snow in all
7
+ directions. The scene is captured with high-speed photography.
8
+ widget:
9
+ - text: A pristine snowglobe featuring a winter scene sits peacefully. The globe violently
10
+ explodes, sending glass, water, and glittering fake snow in all directions. The
11
+ scene is captured with high-speed photography.
12
+ output:
13
+ url: final_video_0.mp4
14
+ tags:
15
+ - text-to-video
16
+ - diffusers-training
17
+ - diffusers
18
+ - lora
19
+ - mochi-1-preview
20
+ - mochi-1-preview-diffusers
21
+ - template:sd-lora
22
+ ---
23
+
24
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
25
+ should probably proofread and complete it, then remove this comment. -->
26
+
27
+
28
+ # Mochi-1 Preview LoRA Finetune
29
+
30
+ <Gallery />
31
+
32
+ ## Model description
33
+
34
+ This is a lora finetune of the Mochi-1 preview model `genmo/mochi-1-preview`.
35
+
36
+ The model was trained using [CogVideoX Factory](https://github.com/a-r-r-o-w/cogvideox-factory) - a repository containing memory-optimized training scripts for the CogVideoX and Mochi family of models using [TorchAO](https://github.com/pytorch/ao) and [DeepSpeed](https://github.com/microsoft/DeepSpeed). The scripts were adopted from [CogVideoX Diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/cogvideo/train_cogvideox_lora.py).
37
+
38
+ ## Download model
39
+
40
+ [Download LoRA](sayakpaul/mochi-lora-dissolve/tree/main) in the Files & Versions tab.
41
+
42
+ ## Usage
43
+
44
+ Requires the [🧨 Diffusers library](https://github.com/huggingface/diffusers) installed.
45
+
46
+ ```py
47
+ from diffusers import MochiPipeline
48
+ from diffusers.utils import export_to_video
49
+ import torch
50
+
51
+ pipe = MochiPipeline.from_pretrained("genmo/mochi-1-preview")
52
+ pipe.load_lora_weights("CHANGE_ME")
53
+ pipe.enable_model_cpu_offload()
54
+
55
+ with torch.autocast("cuda", torch.bfloat16):
56
+ video = pipe(
57
+ prompt="CHANGE_ME",
58
+ guidance_scale=6.0,
59
+ num_inference_steps=64,
60
+ height=480,
61
+ width=848,
62
+ max_sequence_length=256,
63
+ output_type="np"
64
+ ).frames[0]
65
+ export_to_video(video)
66
+ ```
67
+
68
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters) on loading LoRAs in diffusers.
69
+
70
+
71
+
72
+ ## Intended uses & limitations
73
+
74
+ #### How to use
75
+
76
+ ```python
77
+ # TODO: add an example code snippet for running this diffusion pipeline
78
+ ```
79
+
80
+ #### Limitations and bias
81
+
82
+ [TODO: provide examples of latent issues and potential remediations]
83
+
84
+ ## Training details
85
+
86
+ [TODO: describe the data used to train the model]
final_video_0.mp4 ADDED
Binary file (111 kB). View file
 
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b899dd34d5694f61fa00e83bdd5f248534281378ad252b2b8e9450711a825d19
3
+ size 76072152
test_video_0_A_pristine_snowglobe_feat.mp4 ADDED
Binary file (111 kB). View file
 
validation_video_0_A_pristine_snowglobe_feat.mp4 ADDED
Binary file (123 kB). View file