Mastering AnimateDiff Part 2 - Tutorial

2024 ж. 20 Мам.
1 028 Рет қаралды

Second video of the series to know how to use AnimateDiff Evolved and all the options within the custom nodes.
Documentation and starting workflow to use in ComfyUI is available in:
📡 AnimateDiff Evolved: t.ly/GDR_Y
🖥️ Civit.Ai AnimateDiff parts 1 and 2: t.ly/07HuQ
#animatediff #comfyui #stablediffusion
============================================================
💪 Support this channel with a Super Thanks or a ko-fi! ko-fi.com/koalanation
🚨 Use Runpod and I will get credits! tinyurl.com/58x2bpp5 🤗
☕ Amazing ComfyUI workflows here: tinyurl.com/y9v2776r
🔥 Run ComfyUI on the cloud (no install) 🔥
👉 RunDiffusion: tinyurl.com/ypp84xjp 👉15% off first month with code 'koala15'
👉 ThinkDiffusion: tinyurl.com/4nh2yyen
🔥 Do you want to use your own local ComfyUI? 🔥
👾 Upgrade you setup with a RTX 4090 24 GB: tinyurl.com/2s3ajcv3
🖥️ Desktop with RTX 4090 64GB: amzn.to/3V5RXEA
💻 Laptop with RTX 4090 24GB: amzn.to/4am5OLj
🤑🤑🤑 FREE! Check my runnable workflows in OpenArt.ai: tinyurl.com/2twcmvya
============================================================
In this video, we start reworking the old prompt travel template from AnimateDiff Evolved. Then, we look at the two main methods to have better control of AnimateDiff: ControlNet and IP Adapter.
We later continue with the exploration of the options of the Evolved Sampling node in AnimateDiff. Specifically, we look at all the possibilities of Context Options and View Options. By using them, we overcome the number of frame limitations of the Motion Modules of AnimateDiff. With Context Options, we can run smoother animations as long as we want (or the GPU allows us).
Within context options, we learn how the window length and overlap are used. Moreover, we look at more advanced settings like the fuse method, look at the differences between standard static, standard uniform and lopped uniform, the role of the stride and how to combine context options and view options.
In next videos we will further explore how to use sample settings and other tips and tricks to use AnimateDiff.
I hope you enjoy it!
============================================================
📡 AnimateDiff Evolved: t.ly/GDR_Y
👾 AnimateDiff original repo: t.ly/4EbUe
🕹️ AnimateDiff paper: t.ly/F6BeZ
📜 IP Adapter paper: t.ly/02-TD
💃 Checkpoint Coloring Master Anime: t.ly/57QWa
🔌 IP Adapter reference image: t.ly/R_1Ps
🎥 Video flight attendant: tinyurl.com/cuwzs39b
🔖Chapters
============================================================
00:00 Intro
00:32 Setting the workflow
01:56 Prompt travelling
03:40 AnimateDiff + ControlNet
06:16 Stylizing with low denoise
03:35 Using Generation 2 AnimateDiff
07:00 AnimateDiff + IP Adapter
10:05 Context Options: standard static
14:27 Context Options: standard uniform
19:15 Context Options: looped uniform
21:07 View Options
CREDITS
=========================================================
🎵Music
Song: Bike Box, Artist: Kia, Music by: CreatorMix.com
✂️ Edited with Canva, and ClipChamp. I record the stuff in powerpoint.
========================================================
© 2024 Koala Nation
#comfyui #animatediff #stablediffusion

Пікірлер
  • Very cool and detailed tutorial! Wish there was a guide for advanced controlnet's weights too, thanks for your work!

    @PixelArt_YW@PixelArt_YW2 күн бұрын
  • great tutorial as always

    @flavorbot@flavorbot16 күн бұрын
  • All the love your way! You're beyond awesome❤❤❤

    @McConnahan@McConnahan6 күн бұрын
    • You are!

      @koalanation@koalanation6 күн бұрын
  • Thank you for making these Koala, much appreciated

    @kobe5113@kobe511313 күн бұрын
    • You are welcome!

      @koalanation@koalanation12 күн бұрын
  • mmmm nice workflow and tutorial but I got this error: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! my solution is "model = model.to(device)" but I dunno where I have to insert this ... thx in advance

    @erdbeerbus@erdbeerbus5 күн бұрын
    • I am not sure...have you tried to update Animatediff and the Advanced ControlNet nodes? Maybe also Comfyui?

      @koalanation@koalanation4 күн бұрын
    • @@koalanation this is a good tipp //advice ... will do it!

      @erdbeerbus@erdbeerbus3 күн бұрын
    • running :) thank you!!!

      @erdbeerbus@erdbeerbus2 күн бұрын
    • ​@@erdbeerbusGlad it works! 🎉

      @koalanationshorts@koalanationshorts2 күн бұрын
  • You are back!!!

    @omega-yk3wd@omega-yk3wd21 күн бұрын
KZhead