Physics Informed Machine Learning: High Level Overview of AI and ML in Science and Engineering

2024 ж. 14 Мам.
193 340 Рет қаралды

This video describes how to incorporate physics into the machine learning process. The process of machine learning is broken down into five stages: (1) formulating a problem to model, (2) collecting and curating training data to inform the model, (3) choosing an architecture with which to represent the model, (4) designing a loss function to assess the performance of the model, and (5) selecting and implementing an optimization algorithm to train the model. At each stage, we discuss how prior physical knowledge may be embedding into the process.
Physics informed machine learning is critical for many engineering applications, since many engineering systems are governed by physics and involve safety critical components. It also makes it possible to learn more from sparse and noisy data sets.
This video was produced at the University of Washington, and we acknowledge funding support from the Boeing Company
%%% CHAPTERS %%%
00:00 Intro
03:53 What is Physics Informed Machine Learning?
06:41 Case Study: Encoding Pendulum Movement
09:19 The Five Stages of Machine Learning
16:09 A Principled Approach to Machine Learning
20:00 Physics Informed Problem Modeling
21:48 Physics Informed Data Curation
25:34 Physics Informed Architecture Design
28:59 Physics Informed Loss Functions
30:55 Physics Informed Optimization Algorithms
34:56 What This Course Will Cover
46:48 Outro

Пікірлер
  • As a visiting Ph.D. student who is starting a research activity on optimization of PINN, I could not thank you enough for this.

    @chri_pierma@chri_pierma2 ай бұрын
    • do you have any published research? I'm machine learning research in CFD as well

      @FouziaAdjailia@FouziaAdjailia2 ай бұрын
    • @@FouziaAdjailia nope, I just started working on SQP algorithms for neural network optimization with PDE constraints (which easily falls into the PINN category)

      @chri_pierma@chri_pierma2 ай бұрын
    • ​@@chri_pierma SQP as in sequential quadratic programming ?

      @karlmaroun2389@karlmaroun23892 ай бұрын
    • @@karlmaroun2389 that is correct

      @chri_pierma@chri_pierma2 ай бұрын
    • Problem, reaction, solution (optimized predictions or syntropy) -- the Hegelian dialectic. Inputs are dual to outputs. "Always two there are" -- Yoda. Thesis is dual to anti-thesis creates the converging or syntropic thesis, synthesis -- the time independent Hegelian dialectic. Neural networks are using duality to optimize predictions -- a syntropic process, teleological. Enantiodromia is the unconscious opposite or opposame (duality) -- Carl Jung.

      @hyperduality2838@hyperduality28382 ай бұрын
  • This is easily the most exciting video I have seen in so long. Looking forward to the rest of the series!

    @HarishNarayanan@HarishNarayanan2 ай бұрын
  • i don't want to miss any of your lectures. Thank you, professor.

    @lingzhu7554@lingzhu75542 ай бұрын
  • The lecture was outstanding and truly engaging. I'm eagerly anticipating the forthcoming videos in this captivating series, especially with the promise of assessing some intriguing engineering problems.

    @datagigs5478@datagigs54782 ай бұрын
  • I love this channel , he can simplify any most complex topics .

    @qaisalzoubi308@qaisalzoubi3082 ай бұрын
  • Captivating, to say the least. I am so looking forward to this lecture series. Prof. Brunton, I hope that you can deliver on your promises. I am so excited. Hoping to implement a few of the models along the way. Thank you.

    @wadejohnson4542@wadejohnson45422 ай бұрын
  • Thank you for the making these videos available to everyone.

    @aninditadash3204@aninditadash32042 ай бұрын
  • Hi Professor Brunton, I am a high school senior, and I just want to say I love your videos! Your KZhead channel made me realize how much I want to study applied math. Thank you!

    @ajred0581@ajred05812 ай бұрын
    • Unasked for opinion but... Go for it, I was an applied math major w/minor in physics who became fascinated by ML in 2015 after taking Andrew Ng's Coursera course. I work with ML/RL now in the space industry and am a part time PhD student. Best thing ever! These algorithms bring mathematics to life in a crazy way. Plus, the full application of mathematics is barely even scratched yet. I think in the coming years we will see this happen.

      @nias2631@nias26312 ай бұрын
  • Dear Professor Brunton. thanks a lot for putting together a lecture series on such a great topic. Very much looking forward to learn this domain.

    @thoppay76@thoppay762 ай бұрын
  • Professor, I don't think I can stress this enough: thank you for all your and your team's work. As you were laying out the roadmap of what we might be seeing in the future I was getting more and more excited and just could not believe that we are getting this much.

    @lucascarmona1045@lucascarmona10452 ай бұрын
  • I have special interest in the lectures by Pro. Brunton. I wish I had him taught in my education.

    @loipham31@loipham312 ай бұрын
  • How is this channel not millions of subs already?

    @_cogojoe_@_cogojoe_21 күн бұрын
  • This topic looks super exciting and promising, I feel lucky for finding this video, thanks for sharing knowledge like this, professor Brunton

    @franpastor2067@franpastor20672 ай бұрын
  • Really good content, that intro convice me already. Lots of stuff to understand AI, less so to apply it to your work and understant interaction. Thank you.

    @mini-pouce@mini-pouce2 ай бұрын
  • As an undergraduate venturing into wearable robotics, this is literally a gold mine

    @Crappylasagna@Crappylasagna2 ай бұрын
    • wearable robotics? like power armor?

      @GeoffryGifari@GeoffryGifari2 ай бұрын
    • @@GeoffryGifari Yes, thou my thesis is on enhancing athletic performance.

      @Crappylasagna@Crappylasagna2 ай бұрын
  • Absolutely blown away by this video! 🚀 The insights to be shared later are truly fascinating. Can't wait for the entire lecture series on Physical Informed Machine Learning. This topic is incredibly promising, and I'm eager to delve deeper into the subject. Kudos to the creator for such an engaging and informative content! 👏👏

    @khaldibel@khaldibel2 ай бұрын
  • Really looking forward to this!! I've been working on algorithms that take physical properties or measurements for about a decade during a time where machine learning wasn't as popular yet. Really, the most important part of the game was integrating as much knowledge about the physics, statistics and measurement techniques as possible into the reconstruction and apply them as boundary conditions or regularization terms into the optimization. I feel that machine learning can greatly benefit from that on the one side and on the other hand I'm stoked to see what can be done with that combination! 😃

    @climbscience4813@climbscience48132 ай бұрын
  • Thanks very much Professor Brunton. Absolutely engaging lecture! I'm a novice to data science, yet you inspired me to show the potential and applications of physics informed ML. I'll definitely follow the whole series.

    @arunamanipura3864@arunamanipura38642 ай бұрын
  • Omg I've been looking into this. I'm so excited you're doing it man!!

    @xephyr417@xephyr4172 ай бұрын
  • This is really invaluable information. Thanks for making this public. Especially when there's so little talk about it on the internet

    @jatinkm@jatinkmАй бұрын
  • Hello Prof.: Your lectures on PIML / PINN is too Good, awesome. I was looking for these materials for a long time as I wanted to include the knowledge of Physics to guide ML in order to produce better results.

    @biswajyotikar4007@biswajyotikar40072 ай бұрын
  • Always LOVE your content and teaching, Prof Bruton!!! So cool!!! Go SCIENCE!

    @carriefu458@carriefu4582 ай бұрын
  • Simply amazing! So many new concepts that I hadn't noticed as a bystander.

    @RealUniquee@RealUniquee2 ай бұрын
  • Incredibly thankful for this series!

    @tommyhuffman7499@tommyhuffman74992 ай бұрын
  • Can't thank you enough for this course Mr. Brunton

    @et4493@et44932 ай бұрын
  • This series will be gold

    @rocketmike9847@rocketmike98472 ай бұрын
  • As someone who loves Physics and studies CS, I'm excited about this series!

    @dhimitriosduka607@dhimitriosduka6072 ай бұрын
  • Thank you so much! Looking forward to the series.

    @Nickname006@Nickname0062 ай бұрын
  • Thank you very much Prof. Brunton. Looking forward to the course..

    @sun1908@sun19082 ай бұрын
  • Eagerly looking forward to this series. It looks very promising.

    @shlokdave6360@shlokdave63602 ай бұрын
  • I’m a Master’s student studying uncertainty quantification in physics informed ML models. I look forward to seeing your whole course!

    @cameronsmith9448@cameronsmith94482 ай бұрын
  • I cannot thank you enough for this amazing list of lectures!

    @jonahkarafotis@jonahkarafotisАй бұрын
  • Looking forward to this series. Thank you so much in advance

    @ahrenadams@ahrenadams2 ай бұрын
  • Thanks for the video, Steve! What a please to learn from you.

    @chansesyres4117@chansesyres41172 ай бұрын
  • Excellent lecture. Very interesting. Looking forward to the next videos in this exciting series.

    @ggendron1@ggendron12 ай бұрын
  • I've been waiting for this!!! Thank you Professor

    @apocalypt0723@apocalypt07232 ай бұрын
  • I'm looking forward to the videos on optimization techniques that enforce physical constraints!

    @holographictheory1501@holographictheory15012 ай бұрын
  • Thank you for this video, Dr. Brunton

    @Kwes09@Kwes092 ай бұрын
  • Thanks Professor Brunson, excellent material

    @CarlosAvila-kw3tc@CarlosAvila-kw3tc2 ай бұрын
  • started journey really high quality value delivered in the video.Thanks

    @radelfalcao9327@radelfalcao93272 ай бұрын
  • please do release the series as fast as possible as this also happens to be coincident with my mtech thesis timing. Eagerly Awaiting !!!!

    @bharathgopalakrishnan3739@bharathgopalakrishnan37392 ай бұрын
  • thank you so much for putting this out there into the world this is so awesome💙

    @maria4880@maria48802 ай бұрын
  • Thank you for your amazing work. I am super excited for your upcoming lectures.

    @andreizelenco4164@andreizelenco41642 ай бұрын
  • From me and from every AI student fascinated by physics... thank you for this!

    @BrunoRovoletto@BrunoRovoletto2 ай бұрын
  • Thanks! It will help me a lot in my ML course project

    @sebastianascencio9714@sebastianascencio97142 ай бұрын
  • Looking forward for this exciting series

    @siddarajadevangada2890@siddarajadevangada28902 ай бұрын
  • Outstanding, and thank you for sharing.

    @dm20422@dm204222 ай бұрын
  • Thank you for this amazing video!

    @igorkuszczak6065@igorkuszczak60652 ай бұрын
  • Looking forward to it. Would be better if you share the schedule for the upcoming lecture series

    @sridharans9400@sridharans94002 ай бұрын
  • Great stuff! Looking forward to it.

    @jimlbeaver@jimlbeaver2 ай бұрын
  • Best Professor! Thank you!

    @guiliangzheng5704@guiliangzheng57042 ай бұрын
  • Thanks, Steve. Learned a lot.

    @Amir-M-S1997@Amir-M-S19972 ай бұрын
  • Amazing Professor thank you!

    @learningwithandres4906@learningwithandres49062 ай бұрын
  • Loved your lectures

    @kamaljoshi9687@kamaljoshi968715 күн бұрын
  • Omg the algo knows! I was literally chatting with friends about Sora's weak understanding of physics yesterday.

    @chenjus@chenjus2 ай бұрын
  • So exciting, really looking forward to this

    @aditya_a@aditya_a2 ай бұрын
  • So helpful, thanks for a good lecture 😄

    @MZgenstory@MZgenstory2 ай бұрын
  • So happy to see this lecture. PINNs are the key to control and reliability in this decade. Will be exciting to implement

    @matthewfinch7275@matthewfinch72752 ай бұрын
  • Great video, can't wait for more! 🤓

    @harrievolmarijn@harrievolmarijn2 ай бұрын
  • Looking forward to this! Btw I think the PINN reference from Raissi et al is from 2019 rather than 2023.

    @michelspeiser5789@michelspeiser57892 ай бұрын
  • Love You Sir, You are an inspiration.

    @faqeerhasnain@faqeerhasnain2 ай бұрын
  • Will this whole course serie be on youtube, I would be highly interested in it! In any case, it is a pleasure to hear such beautiful lecture on a subject I was triying to figure out myself and I did not know it was currently a research topic XD

    @cziffras9114@cziffras91142 ай бұрын
  • As a sentient AI procrastinating before my next prompt, this was really insightful and introspective

    @Daniel-gj2cd@Daniel-gj2cd27 күн бұрын
  • This is my favorite course ❤so interesting.

    @GastroenterologyPINNs@GastroenterologyPINNs2 ай бұрын
  • What a beautiful lecture Steve for 2024

    @sahandsabet4728@sahandsabet47282 ай бұрын
  • I have an interview on physics-informed ML tomorrow, and I just stumbled upon this! Thank you!

    @moienr4104@moienr41042 ай бұрын
    • good luck!

      @TheAryedemented@TheAryedemented2 ай бұрын
    • @moienr4104 ... so how did it go

      @raheelhammad8905@raheelhammad8905Ай бұрын
    • Hey I wanted to know if it is a field with future scope and demand, and also what kind of qualifications are required for such jobs? Would you like to connect?

      @jatinkm@jatinkmАй бұрын
  • Would love you to cover Physics-informed Deep-O-Nets as well! Thanks a ton for the great material :D

    @changjeffreysinto3872@changjeffreysinto38722 ай бұрын
    • ok I was not at @44:30 when I made the comment don't mind me

      @changjeffreysinto3872@changjeffreysinto38722 ай бұрын
  • Steve - I can't overstate how much i have been enjoying your online courses. Will these PINNs courses include some example code?

    @adamtaylor2142@adamtaylor21422 ай бұрын
  • Eagerly waiting Brunton. Bring it on

    @adilrasheed@adilrasheed2 ай бұрын
  • Subtext here is a lesson to the young STEM persons. The Cutting Edge is alive, tempting, daring, fluid and rewarding. It is easy to field a view that the world is complete and all we need now is caretakers and accountants. Steve demonstrates here how the mind can continually be challenged for broad human benefit. Side note; A+ perfect performance students are needed but so are lessser grade students. Innovation finds improvements from every strata of contribution.

    @nightsailor1@nightsailor12 ай бұрын
  • Problem, reaction, solution (optimized predictions or syntropy) -- the Hegelian dialectic. Inputs are dual to outputs. "Always two there are" -- Yoda.

    @hyperduality2838@hyperduality28382 ай бұрын
  • Thanks for making this video

    @musaalflat4613@musaalflat46132 ай бұрын
  • Thanks a lot for such a great overview of this exciting field! I've just got a paper accepted on TMLR about this very same topic: Effective Latent Differential Equation Models via Attention and Multiple Shooting. I think that many people here might find it interesting: kzhead.info/sun/i72vYZSerKejdok/bejne.html I look forward to the rest of the lectures of this series! :)

    2 ай бұрын
  • Is there a pointer to a description of the studio environment used to create this vid? Very professional and well-done! Sure beats a scratchy chalk board, slide projection in the background, etc!

    @miketaylor3947@miketaylor39472 ай бұрын
  • I'm wonder whether AI has reached the complexity of the human brain yet. Although the human brain has well established speciality areas, so we like in hope. Although, memGPT is a huge breakthrough ! Great video once again.

    @Matlockization@Matlockization2 ай бұрын
  • 24:51 that's the coolest example i've seen so far 🤣😂🥰

    @TerragonCFD@TerragonCFD2 ай бұрын
  • Amazing! Thank you

    @youtube_showcase@youtube_showcase2 ай бұрын
  • Our man's been working out

    @TD-ut9ub@TD-ut9ub2 ай бұрын
  • Great video, professor

    @ninhhoang616@ninhhoang6162 ай бұрын
  • I can't wait to see the model of world!👍

    @waneyvin@waneyvin2 ай бұрын
  • This is so interesting, I’m excited for this series. Where is the pdf of your book?

    @_kantor_@_kantor_2 ай бұрын
  • Good timing! 1 day after the "release" of Sora and V-Jepa

    @MrMiguelChaves@MrMiguelChaves2 ай бұрын
  • Great content! 😊

    @b1chler@b1chler2 ай бұрын
  • keep it up ..big love

    @ahmedgharieb5252@ahmedgharieb52522 ай бұрын
  • Steve the GOAT Brunton back at it again god bless

    @virgenalosveinte5915@virgenalosveinte59152 ай бұрын
  • Thank you!

    @tariq3erwa@tariq3erwa2 ай бұрын
  • 감사합니다. Professor Steve Bruton.

    @dongyeonkim2790@dongyeonkim27902 ай бұрын
    • 이 쪽 분야 공부하시나요?

      @hyeokohol4665@hyeokohol46652 ай бұрын
  • Fantastic!

    @GyovanneMatuchaki@GyovanneMatuchaki2 ай бұрын
  • I love this. ❤

    @davidajaba@davidajaba2 ай бұрын
  • I'm so excited..

    @parikshithk8289@parikshithk82892 ай бұрын
  • Thanks

    @taimoorzain7585@taimoorzain75852 ай бұрын
  • I think it would be pertinent to connect this work to Judea Pearl's work on Directed Acyclic Graphs. The intention of this work will often live at the intervention or counterfactual steps in th3 ladder of causality. It would be important to acknowledge it. If only from a legal perspective, where, in a suit, these matters are criticcal.

    @marc-andredesrosiers523@marc-andredesrosiers5232 ай бұрын
  • Hi Steve is it safe to assume that this is an introduction for a new upcoming series or is this mostly an introduction to your Physics Informed Machine Learning playlist from ~2 years ago? Thank you for providing this awesome series for free. I have always been obsessed with physical science and tech and I think this field is amazing. I can't think of anything I would rather do. That being said, although I will soon graduate from a two year coding bootcamp with a focus on Python and machine learning, I am a little worried about how I could break into this field without attending a PhD or masters program and I do not have the financial resources to afford such a program. It would be great to learn what I should do to start transitioning into this field and proving my worth. This course will surely help my confidence. Thanks again.

    @mason4295@mason42952 ай бұрын
    • Yes indeed, a new series, maybe 5-10 hours of content coming out over the next few months

      @Eigensteve@Eigensteve2 ай бұрын
  • It seems to me that separating the symmetry from the neural network would be far more reliable. Simply including many orientations in the training is the lazy approach. Instead, concentrate on one side (e.g. the left side or the right side) and concentrate on g pointing down while training the network. Then precede the network with a symmetry varying algorithm that rotates the input by 5-10 degrees while watching the correlated output. If the subject has bilateral symmetry, then repeat the process after exchanging x-x. Then consider only the best output(s) when deciding how to classify the image.

    @byronwatkins2565@byronwatkins25652 ай бұрын
  • thankyou

    @danilka7445@danilka7445Ай бұрын
  • Hey, great lecture. Just want to know if this is a good field to explore and do a research on this in my undergrad (final year), if anyone could guide me here..?

    @ashadqureshi4412@ashadqureshi4412Ай бұрын
  • 7:22 i had a weird thought, what if we are the detectors and through our detected differences reality is within view? maybe thats just a thought in connection to the growth of information through each other but maybe this detector isnt just us but the other things around us too and they are sort of detecting us. Like a push pull thing with the differences of reality and we grow just as it grows in difference throught the connections. Maybe thats why evolution works the same as quantum mechanics just with these differences?

    @user-if1ly5sn5f@user-if1ly5sn5f2 ай бұрын
  • Awesome

    @vessela-b8871@vessela-b88712 ай бұрын
  • Waiting for more...

    @georgekurian7408@georgekurian74082 ай бұрын
  • Thank youuuuuu

    @iamnotracist913@iamnotracist9132 ай бұрын
KZhead