a-r-r-o-w HF staff commited on
Commit
30acca2
·
verified ·
1 Parent(s): 4240af4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +62 -0
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Wan-AI/Wan2.1-T2V-1.3B
4
+ - Wan-AI/Wan2.1-T2V-1.3B-Diffusers
5
+ datasets:
6
+ - finetrainers/3dgs-dissolve
7
+ library_name: diffusers
8
+ license: other
9
+ license_link: https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B/blob/main/LICENSE.txt
10
+ widget:
11
+ - text: >-
12
+ A lone sailor grips the helm as towering waves crash against the boat. Lightning splits the sky, illuminating the chaotic sea. The storm intensifies, but then, as if merging with the elements, the sailor's figure slowly transforms into a cascade of red sparks, scattering into the wind.
13
+ output:
14
+ url: 3DGS_DISSOLVE_A_lone_sail-81.mp4
15
+ - text: >-
16
+ A snowboarder carves through fresh powder, the mountain landscape unfolding in crisp whites and deep blues. They launch into the air, spinning weightlessly before their form dissipates into a dazzling explosion of glowing embers that swirl into the icy breeze.
17
+ output:
18
+ url: 3DGS_DISSOLVE_A_snowboard-81.mp4
19
+ - text: >-
20
+ A stark white bowl floats in darkness, its form slowly twisting. It begins to crack apart, glowing embers spilling outward, until it evaporates into a breathtaking eruption of red sparks. The scene transitions—now, a bouquet of flowers stands in its place, untouched, frozen in time.
21
+ output:
22
+ url: 3DGS_DISSOLVE_A_stark_whi-81.mp4
23
+ - text: >-
24
+ A surfer carves through the curling wave, sunlight glinting off the water's surface. The tunnel of shimmering liquid twists around them, and just as they reach the crest, their form flickers—evaporating into a dazzling explosion of fiery sparks that vanish into the ocean spray.
25
+ output:
26
+ url: 3DGS_DISSOLVE_A_surfer_ca-81.mp4
27
+ tags:
28
+ - text-to-video
29
+ - diffusers-training
30
+ - diffusers
31
+ - template:sd-lora
32
+ - wan
33
+ ---
34
+
35
+ <Gallery />
36
+
37
+ This is a LoRA fine-tune of the [Wan-AI/Wan2.1-T2V-1.3B-Diffusers](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B-Diffusers) model on the
38
+ [finetrainers/3dgs-dissolve](https://huggingface.co/datasets/finetrainers/3dgs-dissolve) dataset.
39
+
40
+ Code: https://github.com/a-r-r-o-w/finetrainers
41
+
42
+ > [!IMPORTANT]
43
+ > This is an experimental checkpoint and its poor generalization is well-known.
44
+
45
+ Inference code:
46
+
47
+ ```python
48
+ import torch
49
+ from diffusers import WanPipeline
50
+ from diffusers.utils import export_to_video
51
+
52
+ pipe = WanPipeline.from_pretrained(
53
+ "Wan-AI/Wan2.1-T2V-1.3B-Diffusers", torch_dtype=torch.bfloat16
54
+ ).to("cuda")
55
+ pipe.load_lora_weights("finetrainers/Wan2.1-T2V-1.3B-3dgs-v0", adapter_name="wan-lora")
56
+ pipe.set_adapters(["wan-lora"], [0.5])
57
+
58
+ video = pipe("<my-awesome-prompt>").frames[0]
59
+ export_to_video(video, "output.mp4", fps=24)
60
+ ```
61
+
62
+ Training logs are available on WandB [here](https://wandb.ai/aryanvs/finetrainers-wan).