2024-12-10 22:20:40,420 - __main__ - INFO - num_videos: 50 output_root_dir: outputs_videos output_dir: ${output_root_dir}/${now:%Y-%m-%d_%H-%M-%S}/benchmark_video_generation generate_kwargs: negative_prompt: '' num_inference_steps: 50 guidance_scale: 6 num_frames: 45 prompt_sources: - static/prompts get_pipeline: _target_: accediff.utils.factory.pipeline_factory.get_cogvideox_pipeline_with_tome_attnbin repo_id: THUDM/CogVideoX-2b hook_kwargs: merge_ratio: 0.5 sb: 18 tome_modele_names: - transformer_blocks.{0..27..2}.attn1 2024-12-10 22:20:42,402 - bitsandbytes.cextension - DEBUG - Loading bitsandbytes native library from: /scratch/yz10381/miniconda3/envs/diffusers/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda124.so 2024-12-10 22:20:43,095 - matplotlib - DEBUG - matplotlib data path: /scratch/yz10381/miniconda3/envs/diffusers/lib/python3.10/site-packages/matplotlib/mpl-data 2024-12-10 22:20:43,100 - matplotlib - DEBUG - CONFIGDIR=/home/yz10381/.config/matplotlib 2024-12-10 22:20:43,101 - matplotlib - DEBUG - interactive is False 2024-12-10 22:20:43,101 - matplotlib - DEBUG - platform is linux 2024-12-10 22:20:43,130 - matplotlib - DEBUG - CACHEDIR=/scratch/yz10381/.cache/matplotlib 2024-12-10 22:20:43,131 - matplotlib.font_manager - DEBUG - Using fontManager instance from /scratch/yz10381/.cache/matplotlib/fontlist-v390.json 2024-12-10 22:20:43,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): huggingface.co:443 2024-12-10 22:20:43,308 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "GET /api/models/THUDM/CogVideoX-2b HTTP/11" 200 1943 2024-12-10 22:20:43,340 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "HEAD /THUDM/CogVideoX-2b/resolve/main/model_index.json HTTP/11" 200 0 2024-12-10 22:20:49,963 - accediff.utils.factory.pipeline_factory - INFO - Available config keys: odict_keys(['num_attention_heads', 'attention_head_dim', 'in_channels', 'out_channels', 'flip_sin_to_cos', 'freq_shift', 'time_embed_dim', 'text_embed_dim', 'num_layers', 'dropout', 'attention_bias', 'sample_width', 'sample_height', 'sample_frames', 'patch_size', 'temporal_compression_ratio', 'max_text_seq_length', 'activation_fn', 'timestep_activation_fn', 'norm_elementwise_affine', 'norm_eps', 'spatial_interpolation_scale', 'temporal_interpolation_scale', 'use_rotary_positional_embeddings', 'use_learned_positional_embeddings', '_use_default_values', '_class_name', '_diffusers_version', '_name_or_path']) 2024-12-10 22:20:49,963 - accediff.utils.factory.pipeline_factory - INFO - f: 12, h: 30, w: 45, sb: 18 2024-12-10 22:20:49,965 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.0.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,965 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.0.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,965 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.2.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,965 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.2.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,965 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.4.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,965 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.4.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.6.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.6.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.8.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.8.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.10.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.10.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.12.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.12.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.14.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.14.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.16.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.16.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.18.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.18.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.20.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.20.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.22.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.22.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.24.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.24.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.26.attn1 with pre forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,966 - accediff.utils.factory.pipeline_factory - INFO - Wrapping transformer_blocks.26.attn1 with post forward hook .tome_post_forward_hook at 0x151565813ac0> 2024-12-10 22:20:49,969 - __main__ - INFO - Saving videos to outputs_videos/2024-12-10_22-20-40/benchmark_video_generation/videos 2024-12-10 22:20:49,970 - __main__ - INFO - Running iter_generate_prompt2video with 3 warmup iterations 2024-12-10 22:21:29,297 - __main__ - INFO - Warmup step 1: 38.9318060874939 seconds 2024-12-10 22:22:07,350 - __main__ - INFO - Warmup step 2: 37.65672421455383 seconds 2024-12-10 22:22:44,997 - __main__ - INFO - Warmup step 3: 37.291226863861084 seconds 2024-12-10 22:52:18,663 - __main__ - INFO - Total time: 1755.835159778595 seconds for 47 iterations, throughput: 0.026767888624537252 iterations/second