Diffusion Models | Paper Explanation | Math Explained

2024 ж. 16 Мам.
218 148 Рет қаралды

Diffusion Models are generative models just like GANs. In recent times many state-of-the-art works have been released that build on top of diffusion models such as #dalle or #imagen. In this video I give a detailed explanation of how they work. At first I explain the fundamental idea of these models and later we dive deep into the math part. I try to explain all of this on a really easy & intuitive level. After the math derivation, we look at the results from different papers and how they compare to other methods.
#diffusion #dalle2 #dalle #imagen
00:00 Introduction
02:48 Idea & Theory
07:06 Architecture
09:33 Math Derivation
26:59 Algorithms
28:22 Improvements
29:43 Results
31:34 Summary
Further Reading:
1. Paper: arxiv.org/pdf/1503.03585.pdf
2. Paper: arxiv.org/pdf/2006.11239.pdf
3. Paper: arxiv.org/pdf/2102.09672.pdf
4. Paper: arxiv.org/pdf/2105.05233.pdf
5. VAE & Reparam. Trick: lilianweng.github.io/posts/20...
6. Written Tutorial: lilianweng.github.io/posts/20...
PyTorch Implementation Video: • Diffusion Models | PyT...
Follow me on instagram lol: / dome271

Пікірлер
  • Here is the implementation video in PyTorch: kzhead.info/sun/h6Z8gtCmrnyqjY0/bejne.html

    @outliier@outliier Жыл бұрын
    • Q

      @bootsncats1873@bootsncats1873 Жыл бұрын
    • Hello, How did you make the animations in your video?

      @homataha5626@homataha5626 Жыл бұрын
  • Explaining the notations is a game changer... more educational content channels should do this.

    @ulamss5@ulamss5 Жыл бұрын
  • I've watched a bunch of videos trying to understand Diffusion (Ari Seff, Assembly AI etc) and this one taught me the most by far. Please keep making videos!

    @christiandeverall5661@christiandeverall5661 Жыл бұрын
  • Hey, thanks very much for making this wonderful video! I just want to appreciate the fact that all notations are clearly explained before going into the math part. That helps a lot! Great work!

    @sauvage_pikachu@sauvage_pikachu Жыл бұрын
  • What an amazing video!! I looked everywhere for a comprehensible video about Diffusion Models and yours was simply the best… Please keep up the effort and the great content :)

    @felixvgs.9840@felixvgs.9840 Жыл бұрын
  • You are the Outlier we cannot miss! Real gem. Thanks for the explanation man!

    @nikitadeshpande6643@nikitadeshpande6643 Жыл бұрын
  • Excellent presentation. Great balance between depth and succinctness. Thank you!

    @SteveSperandeo@SteveSperandeo Жыл бұрын
  • After going through 4 different YT videos, yours was the only one that was clear enough for me to understand. Thank you very much!

    @vladi21k@vladi21k Жыл бұрын
  • Thank you so much for making this video! It was very clear and I really appreciate how you walked through the math and the reasoning for how they went from the initial loss to writing it in terms of predicting the noise. Everything was well made. I look forward to watching your other videos!

    @elisawarner7942@elisawarner7942 Жыл бұрын
  • Very well explained! You made sure to include a lot of important points others either omit or simply skim over. Thank you very much.

    @akshayshrivastava97@akshayshrivastava97 Жыл бұрын
  • This video is amazing. I think the format of your video was incredible, you went over the literature and told us how we got there, you went over the high-level explanation then got into the nitty-gritty detail and then just in case we miss something you gave an amazing recap. This is how all videos on deep learning should be. Especially as we're getting into more Niche topics.

    @user-sz1iw4zi4y@user-sz1iw4zi4y Жыл бұрын
  • Excellent video! Very clear derivation, and good animation. You are a good teacher with loads of patience, and guided us step by step!

    @xiaohaolin6464@xiaohaolin6464 Жыл бұрын
  • Absolute king! Your work is such an important part of this community

    @anujshah7949@anujshah7949 Жыл бұрын
  • This is incredible! Did not see a video with the math explanations of diffusion models yet. And you animated it in manim! Just great. 😎

    @AICoffeeBreak@AICoffeeBreak Жыл бұрын
    • thank you so much! actually it's not even animated with manim. It's all done in Premiere Pro haha. But I guess that I'll definitely do those things in manim in future videos....

      @outliier@outliier Жыл бұрын
    • @@outliier Thanks for sharing bit how do ppl.not get bored and frustrated during the math lart..even if you are a math genius..and if you don't think of the smweird step of taking out the first term of the sum..can't you still reach the same goal? So why do thst at all?

      @leif1075@leif1075 Жыл бұрын
  • This is the first source I was able to find that explained the math behind diffusion models in a comprehensible way instead of glossing over it. Thanks a lot, you have earned my like and subscribe with just this video alone!

    @ravindrabisram137@ravindrabisram137 Жыл бұрын
  • Thank you for making such a high quality video explaining the math. Often, other channels do not emphasize on the math and this video is perfectly putting light on how exactly the math fits in diffusion models. Thank you for your amazing work. Please, make more such content!

    @JasimUsmani@JasimUsmani Жыл бұрын
  • This is the best explanation I have found so far. Thank you.

    @TheKkunte@TheKkunte Жыл бұрын
  • Explaining the mathematical reasoning and formulas behind the model in such detailed fashion is amazing , keep up your good work

    @kumaranragunathan7602@kumaranragunathan7602 Жыл бұрын
  • this is by far the best video on diffusion models that explains the math clearly, great job!

    @kartikeyabhardwaj3919@kartikeyabhardwaj3919 Жыл бұрын
  • Wow……. Haven’t read math in a while, this was explained excellently. I have a masters degree in physics but don’t do much math anymore since my degree in 2017. I really like how much detail you went into with the derivations and the pausing to ground what we are doing with some intuition. Well done man 🎉

    @StephenRayner@StephenRayner Жыл бұрын
  • Easily the best video on Diffusion models. Great work!

    @user-os4tw9hl5w@user-os4tw9hl5w11 ай бұрын
  • This was the best ML paper review I have ever seen. You stopped making videos but I would really love to see you go through more of this for more research in the field man! Hatsoff to you.

    @AdmMusicc@AdmMusicc2 ай бұрын
  • Brilliant approach of lining up equations into a story, great work, thanks!

    @kateyurkova6384@kateyurkova63848 ай бұрын
  • Absolutely brilliant coverage! Keep up the good work. You are helping a lot of people.

    @FLLCI@FLLCI Жыл бұрын
  • you're a GOAT for this man, bringing together intuition and math notation is drastically underrepresented in general, thanks so much for this video

    @user-fj9bh7kt7t@user-fj9bh7kt7t Жыл бұрын
  • Wow, this is absolutely brilliant. Massive kudos for making quite the complex topic significantly more digestible!

    @NicholasRenotte@NicholasRenotte Жыл бұрын
  • One of the best explanations here on KZhead - thank you very much! 🥳

    @Steveineiter@Steveineiter Жыл бұрын
  • I really like your math part! Please keep going amazing work!

    @icejust9195@icejust91958 ай бұрын
  • Man, this is incredible. When I saw these equations in the paper and other sources I was like "no way I am gonna understand that".. but with this video it all makes sense. Brilliantly done, thank you so much for your work. Instant subscribe and I am going to check other content on your channel :D

    @NellyParsley@NellyParsley Жыл бұрын
  • Wow! Amazing job explaining diffusion models and why they use the math they do.

    @JBoy340a@JBoy340a Жыл бұрын
  • Many thanks for this. I'm an artist with very limited math skills and though I can't say I understood the whole, your teaching gave me a solid basis and an understanding of this I've been wanting. You have another fan.

    @timforcade1029@timforcade1029 Жыл бұрын
  • This is the first ever video of you that I get to see. Congrats, truly amazing. I believe you are among the first people on YT to dig into the math equations of ML papers like this, and I believe it's truly valuable. Keep it up!

    @brianpulfer4159@brianpulfer4159 Жыл бұрын
  • Amazing! The visualization is great and easy to follow.

    @PakkaponPhongtawee@PakkaponPhongtawee Жыл бұрын
  • I just watched your video on diffusion models, and I am incredibly impressed with the depth of information you provided. Your explanation was clear, concise, and immensely helpful. Thank you for sharing your knowledge on this topic. I learned a lot from your video and I truly appreciate your efforts in creating such valuable content.

    @mohammadpishbin@mohammadpishbin7 ай бұрын
  • Thank you so much for delving deep into the math. I'm an engineer (not software) and self-learning AI. The papers are unfortunately not written in the most explainable way, and even though I've taken high level math courses for my degree, the notation and terminology in the papers make it pretty inaccessible and frustrating to follow. Thanks for going through this paper, I hope you continue to make more videos.

    @InturnetHaetMachine@InturnetHaetMachine Жыл бұрын
  • this video is *by far* the best video on diffusion models i've seen on youtube. this was very pleasant to watch and you made everything really clear. brilliant!! i subscribed and turned on notifications :) have an amazing day :)

    @oriyonay8825@oriyonay8825 Жыл бұрын
  • awesome explanations!! look forward to more brilliant tutorial/explanation vids!!

    @yahuiz7877@yahuiz7877 Жыл бұрын
  • Nicely explained. Most of the people leave these derivatives thinking it would make the tutorial boring but without these derivativation we don't understand how was the methodology evolved. Great job reasearching and explaining.

    @codingblaze4611@codingblaze4611 Жыл бұрын
  • Wow this is such a fantastic explanation. I love how you describe the intuitions behind the authors' mathematical choices.

    @srinathkumar1452@srinathkumar145211 ай бұрын
  • Thank u for the detailed explaination, looking forward for your pytorch implementation video!

    @andyfeng6@andyfeng6 Жыл бұрын
  • Just the video that I needed, thanks so much!!!

    @chiscoduran9517@chiscoduran9517 Жыл бұрын
  • I started reading articles and looking for learning content on diffusion modelling and the notation seemed a bit difficult. However, I am only half way through this video and I can assure you that this video is a must watch. Very clear explanation, I will recommend it to anyone interested in exploring this field, congratulations on your work!

    @javiersolisgarcia@javiersolisgarcia5 ай бұрын
  • Thank you so much. I actually just recently worked out a lot of this math a couple weeks ago for a model I'm building and this video would've saved me so much time. Very clear. Thank you 🙏

    @TheSeamau5@TheSeamau5 Жыл бұрын
  • You're the GOAT man, very great summary of diffusion

    @frapbrab664@frapbrab664 Жыл бұрын
  • Best video on diffusion model right now because of the math derivation of everything. Thank you!

    @markpayton3895@markpayton3895 Жыл бұрын
  • You have a superpower of explaining math. Really enjoyed it.

    @bayesianmonk@bayesianmonk Жыл бұрын
  • Thanks for the fantastic introduction!! Well made video!

    @yuhonglin8898@yuhonglin8898 Жыл бұрын
  • Thanks for the simple but detailed explanation! I wouldn't be able to understand the topic without your video.

    @itsnotthattough7588@itsnotthattough75888 ай бұрын
  • just the best expanation by far I have seen in days of searching. congrats

    @inakitodc6816@inakitodc68166 ай бұрын
  • what a wonderful and thoughtful way to deliver the whole langscape of the diffusion model! Nice video! 👍

    @user-sc7nn9sz3r@user-sc7nn9sz3rАй бұрын
  • The most clear explanation I’ve seen on YT. Much more clear than that from MIT lectures lol Many thanks

    @cutethanks@cutethanks2 ай бұрын
  • The video is perfect! Thank you so much. You helped me to understand better all the formulation! Thanks again!!

    @sergiomanuel2206@sergiomanuel2206 Жыл бұрын
  • I was just using those tools to generate images but due to this video i got a lot more interested in understanding how they work. I hope you keep doing this kind of videos.

    @wdabrilvi@wdabrilvi Жыл бұрын
  • Fantastic video, man. Explained the stuff really really well. Thanks.

    @MK-yj7pn@MK-yj7pn Жыл бұрын
  • Just want to say thank you. I believe this is one of the most high-quality videos I have ever seen given on diffusion models! Keep it going. I have subscribed!

    @sedi_rockstar7481@sedi_rockstar7481 Жыл бұрын
    • thank you so much!

      @outliier@outliier Жыл бұрын
  • Truly awesome! Looking forward to the upcoming Pytorch implementation video!

    @Wondaful-mr2dl@Wondaful-mr2dl Жыл бұрын
  • Great Video! Hands down the best explanation of DDPM’s math

    @williamdevena8565@williamdevena8565 Жыл бұрын
  • Great explanation, thank you for sharing your knowledge! Subscribed!

    @statixvfx1793@statixvfx1793 Жыл бұрын
  • Superb work. 1. Gone through the history of diffusion of models by explaining all the previous papers. 2. Giving an intuition of whole idea. 3. Explaining math behind it. 4. Also incorporating future prospects

    @checkout8352@checkout8352 Жыл бұрын
  • Thank you. Your explanation has been profoundly enlightening and exceptionally lucid, providing me with a comprehensive understanding.

    @RezaSoumi@RezaSoumi9 ай бұрын
  • Tons of thanks for this amazing explanation!!

    @Shashank-vv4ex@Shashank-vv4ex10 ай бұрын
  • Awesome! Right what I was looking for. Thank you for the explanation !)

    @user-ri9lg7dh7c@user-ri9lg7dh7c Жыл бұрын
  • Thanks, the video was really helpful, it gave me such a great time in understanding diffusion models, kudos and keep on making such quality content!

    @autkarsh8830@autkarsh88302 ай бұрын
  • The explaination about loss function, especially the part of KL divergence, is amazing! I love your video!

    @riazzai9250@riazzai92508 ай бұрын
  • Greatly explained the papers and it's depend topics 👏👏👏

    @fahim78611@fahim78611 Жыл бұрын
  • I salute your hardwork on this video. Thank you from the bottom of my heart. 😃

    @ashok_learn@ashok_learn Жыл бұрын
  • For those who are confused about the recursive expansion at 13:13 (like I did), it's "a property of Gaussian distributions, where the variance of the sum of two independent Gaussian variables is the sum of their variances. "

    @-long-@-long-7 ай бұрын
    • I'm confused about the notation q(Xt|Xt-1) and p(Xt-1|Xt). Never seen the result of a function presented as part of the argument before. Not even sure I understood which is which from his prose.

      @herrbonk3635@herrbonk36354 ай бұрын
    • Seems to follow from uncorrelated noise variables at different steps, using the formula var(X1+X2)=var(X1)+var(X2)+2cov(X1,X2) where cov(X1,X2)=0. We don't seem to need to use normality here

      @yogeshsingular@yogeshsingular3 ай бұрын
  • So satisfied to know that we just need to predict the noise!!! After so many formulars...🙏🙏🙏

    @yyq90@yyq90 Жыл бұрын
  • Very well done. Animations are super helpful and the math explanation is clear.

    @stevemurch3245@stevemurch3245 Жыл бұрын
  • Excellent video mate, keep up the good work ✌️✌️

    @deadbeat_genius_daydreamer@deadbeat_genius_daydreamer9 ай бұрын
  • Thank you for the wonderful explanation!

    @fizzarubab8959@fizzarubab89598 ай бұрын
  • Thanks for the great explanation!!! This video is amazing!

    @ziyuwan4513@ziyuwan4513 Жыл бұрын
  • I'm grateful to you for all your help

    @azmerawyotorawi684@azmerawyotorawi6846 ай бұрын
  • that was really enjoyable!! Thank you very much!

    @homataha5626@homataha5626 Жыл бұрын
  • Nice explaination in Math. Rarely see a such detailed diffusion model explaination video. Good job and thanks

    @pengxiaohan3371@pengxiaohan3371 Жыл бұрын
  • Really a life savior, thank you so much!!

    @joyshen9015@joyshen901511 ай бұрын
  • Well explained, Thanks for the great explanation man!

    @shakibyazdani9276@shakibyazdani9276 Жыл бұрын
  • Thank you for the explanation, it's really well made, I can see you put a lot of efforts in it, well done! 👏👍

    @IndrainKorea@IndrainKorea Жыл бұрын
  • This helps me a lot! You are really a good presenter.

    @QuOUseTERSEa@QuOUseTERSEa Жыл бұрын
  • The detailed explanation is mindblowing. I learned a lot today. Thank You.❣

    @rajatagrawal5339@rajatagrawal533910 ай бұрын
  • Men! you did awesome !. Subscribed and I'll keep learning

    @WWG1-WGA@WWG1-WGA7 ай бұрын
  • this is amazing how you explain the maths. thank you for sharing. Thank you a lot

    @dockosow7187@dockosow7187 Жыл бұрын
  • Great video, thank you for this!

    @Magnify.@Magnify. Жыл бұрын
  • Video is really well made. You did well to summarize to keep things simple and explanatory.

    @spiritual-Aatma@spiritual-Aatma4 ай бұрын
  • Viele danke for explaining all of this so clearly.

    @Jianju69@Jianju69 Жыл бұрын
  • Really great video. We need more videos like this. Helped me understand cryptic papers which can be very frustrating...

    @yogeshsingular@yogeshsingular3 ай бұрын
  • Wonderful video! This really helps me to better understand the threom behind ddpm, many thanks

    @user-gq6hm8kn6t@user-gq6hm8kn6t6 ай бұрын
  • Keep going mate, this one is an amazing video about the subject

    @simonetruglia@simonetruglia Жыл бұрын
  • Hopping for more great contents .

    @sanjaybhandari2487@sanjaybhandari2487 Жыл бұрын
  • Such a great video, you got insane intelligence to explain such a paper like this. Thanks

    @hayagreevsivakumar9188@hayagreevsivakumar9188 Жыл бұрын
  • This breakdown is godsend!

    @chemaguerra1635@chemaguerra1635 Жыл бұрын
  • Would have upvoted several times. Yours is the first video I found that actually goes into the math. Others just slap it onto the screen as fact, dazzling and confusing the viewer.

    @crackwitz@crackwitz Жыл бұрын
  • awesome content, thanks for sharing!

    @CarloRobiati@CarloRobiati Жыл бұрын
  • Thank you for your efforts. 🙏🏻

    @arpitpatel5814@arpitpatel58143 ай бұрын
  • This is a really great video, thanks for your big effort explaining!

    @jefersongallo8033@jefersongallo803319 сағат бұрын
  • This is my first time leaving a comments under a ML tutorial YT channel. The explanation is amazing intuitive, thanks for sharing your knowledge and creating this video!

    @ryanl1988@ryanl1988 Жыл бұрын
    • So nice to hear that thank you!

      @outliier@outliier Жыл бұрын
  • Fantastic video, looking for your next video !

    @ruoyufeng6727@ruoyufeng6727 Жыл бұрын
  • i just watched like 5 of these videos on this subject, specifically the math. This was the best one by far. You should teach.

    @cleverclover7@cleverclover74 ай бұрын
  • Thanks! A great explanation!

    @vikimazo@vikimazo4 ай бұрын
  • really nice explanations!! thank you so much

    @kelseywang7709@kelseywang7709 Жыл бұрын
KZhead