Large Language Models from scratch

2024 ж. 2 Мам.
330 468 Рет қаралды

How do language models like chatGPT and Palm work? A short cartoon that explains transformers and the tech behind LLMs.
Part 2: • Large Language Models:...
0:05 - autocomplete
0:44 - search query completion
1:03 - language modeling with probabilities
1:59 - time series and graphs
2:34 - text generation
3:43 - conditional probabilities
3:52 - trigrams
4:49 - universal function approximation
5:19 - neural networks
6:33 - gradient descent
7:03 - back propagation
7:24 - network capacity

Пікірлер
  • This is seriously *really* good, I've not seen someone introduce high level concepts by-example so clearly (and nonchalantly!)

    @triton62674@triton62674 Жыл бұрын
    • What have they done? amazing stuff

      @brendawilliams8062@brendawilliams806211 ай бұрын
    • Agree. I have it on one of my playlists now.

      @PabloMoscato@PabloMoscato29 күн бұрын
  • This is so good. I can't believe it has so few views.

    @somethingness@somethingness Жыл бұрын
    • Same, brillant explaination on NN

      @adarshraj1467@adarshraj1467 Жыл бұрын
    • Was just about to write the same.

      @facqns@facqns Жыл бұрын
    • if you really think so, post the link to this video on your social media.

      @webgpu@webgpu Жыл бұрын
    • So few views... If a Kardashian posts a brain fart it gets more views from the unwashed masses. That is the sad reality.

      @itsm3th3b33@itsm3th3b33 Жыл бұрын
    • Very few study about it

      @phil5053@phil5053 Жыл бұрын
  • Finally! Someone who knows how explain complexity with simplicity.

    @solotron7390@solotron739013 күн бұрын
  • This is an excellent articulation. We need part 3, 4, and 5

    @ivocamilleri8913@ivocamilleri8913 Жыл бұрын
  • this is excellently done, I'm very grateful for you putting this together.

    @saqhorov@saqhorov Жыл бұрын
  • Being able to visualize this so simply is legendary. You're doing amazing work. Subbed

    @JessieJussMessy@JessieJussMessy Жыл бұрын
  • These visuals were SO HELPFUL in introducing and understanding some foundational ML concepts.

    @SethWieder@SethWieder Жыл бұрын
  • Great video. "energy function" instead of error function, but a great explanation of gradient descent and backprop in a super short time. Excellent job!

    @noahnazareth8248@noahnazareth8248 Жыл бұрын
  • You have made it so easy to see and understand - it puts into place all the complicated explanations that exist out there on the net.

    @marktahu2932@marktahu2932 Жыл бұрын
  • I really liked your explanation of how "training a network" is performed. Made it a lot easier to understand

    @ericsun1990@ericsun1990 Жыл бұрын
  • This was awesome. I don't think I could adequately explain how this all works yet, but it fills in so many gaps. Thank you for this video!

    @AncientSlugThrower@AncientSlugThrower Жыл бұрын
  • Wow. This is so well presented. And a different take that gets to the real intuition.

    @user-wr4yl7tx3w@user-wr4yl7tx3w Жыл бұрын
  • possibly the best explanation of LLM i've ever seen. accurate, pointed and concise

    @liamcawley6440@liamcawley6440 Жыл бұрын
  • Brilliant! A truly example of intelligence and simplicity to explain! Thanks a lot.

    @lfmtube@lfmtube Жыл бұрын
  • That might be the best, most concise and impactful neural network introduction I have seen to date

    @GregMatoga@GregMatoga11 ай бұрын
  • such clean and lucid explanation. amazing

    @wokeclub1844@wokeclub1844 Жыл бұрын
  • i generally don't subscribe to any channels but this one deserves one. This takes a lot of understanding and love for the subject to do these kind of videos. thank you very much

    @narasimhasriharshakanduri3325@narasimhasriharshakanduri3325 Жыл бұрын
  • Very clear and concise explanation! Excellent work!

    @gigabytechanz9646@gigabytechanz964611 ай бұрын
  • This is an insanely good explanation. Subscribed.

    @looppp@looppp Жыл бұрын
  • Awesome video! I really appreciated your explanation and representation of neural networks and how the number of nodes and weights affect the accuracy.

    @BenKordick@BenKordick Жыл бұрын
  • Stunning video of absolutely high and underrated quality !!!! Thanks so much, for this !

    @laStar972chuck@laStar972chuck Жыл бұрын
  • you sir, deserve my subscription. This was so good.

    @funnycompilations8314@funnycompilations8314 Жыл бұрын
  • Great video. The example of the network with too few curve functions to recreate the graph really helped me understand how more or fewer nodes affects the accuracy of the result.

    @darinmcbride4003@darinmcbride4003 Жыл бұрын
  • You are so good at explaining it! Please keep doing it.

    @govinddwivedi582@govinddwivedi582 Жыл бұрын
  • Amazingly insightful. Fantastically well explained. Thanks !

    @DimitriMissentos@DimitriMissentos Жыл бұрын
  • Incredibly well explained! Thanks a lot!

    @A338800@A33880010 ай бұрын
  • Thanks Steve, this explanation is just... Brillant! 😊

    @pierrickguillard-prevert4213@pierrickguillard-prevert421310 ай бұрын
  • Straight away subscribed .... i would really love these videos in my feed daily.❤

    @saurabhmaurya6380@saurabhmaurya63807 ай бұрын
  • Fascinating and such wonderful explanation. Thank you very much!

    @sudhindrakopalle7071@sudhindrakopalle7071 Жыл бұрын
  • Excellent. Some of the best work I've seen. Thanks.

    @marlinhowley9858@marlinhowley9858 Жыл бұрын
  • very well explained!

    @YusanTRusli@YusanTRusli7 ай бұрын
  • Unbelievably good video. Great work.

    @mirabirhossain1842@mirabirhossain1842 Жыл бұрын
  • Best and simplest explanation I have ever come across. Thank you sir

    @coderversion1@coderversion1 Жыл бұрын
  • I've been watching a lot of videos on LLMs and the underlying mathematics. This explanation is PHENOMENAL. Not dumbed down, not too long, and uses concepts of existing maths and graphing that cement the concept perfectly.

    @stratfanstl@stratfanstl5 ай бұрын
  • Brilliantly explained !

    @shreeramshankarpattanayak7409@shreeramshankarpattanayak740911 ай бұрын
  • I had not considered exactly how words related to eachother in automated texts and this video explained that concept in a really clear and concise way.

    @samwynn3183@samwynn3183 Жыл бұрын
  • nice concise video explaining what is a large language model

    @jankshtt@jankshtt Жыл бұрын
  • This is the best explanation of Large Language Models. I hope your channel gets more subscribers!

    @SaidakbarP@SaidakbarP Жыл бұрын
  • Very nice illustration and fantastic explanation. Thanks

    @ravinatarajan4894@ravinatarajan4894 Жыл бұрын
  • The best content ever I saw about the subject. Super dense and easy.

    @lipefml7200@lipefml720010 ай бұрын
  • Very well explained. Thank you for the video!

    @LittleShiro0@LittleShiro0 Жыл бұрын
  • This is fantastic. Thank you for sharing.

    @ryusei323@ryusei3238 ай бұрын
  • Incredible. Thank you

    @kahoku451@kahoku451 Жыл бұрын
  • Really great description 👌

    @gregortidholm@gregortidholm Жыл бұрын
  • Probably one of the best explanations I've come across. :)

    @WoonCherkLam@WoonCherkLam Жыл бұрын
  • Absolutely brilliant..great examples

    @ammarlahori@ammarlahori7 ай бұрын
  • This is awesome. Very good Illustrations.

    @zhenli8674@zhenli8674 Жыл бұрын
  • Clearly explained! I will use it.

    @marcusdrost8452@marcusdrost84524 ай бұрын
  • You are a genius, thank you for this amazing video!

    @ashleygesty7671@ashleygesty7671 Жыл бұрын
  • Really great explanation of LLM! Just earned a subscriber and I'm looking forward to more of your videos :)

    @BeSlaying@BeSlaying Жыл бұрын
  • Clean and clear explaination

    @smithwill9952@smithwill9952 Жыл бұрын
  • Simple and clear, kudos!

    @lucamatteobarbieri2493@lucamatteobarbieri2493 Жыл бұрын
  • Holy shit. This is one of the best KZhead videos I've seen all year so far. Bravo 👏👏👏

    @KalebPeters99@KalebPeters99 Жыл бұрын
  • This is t he best explanation of LLMs I've seen

    @DanielTateNZ@DanielTateNZ Жыл бұрын
  • Great explanation of an advanced topic

    @jacobwilliams4182@jacobwilliams4182 Жыл бұрын
  • Wow, what a fantastic explanation!

    @darrin.jahnel@darrin.jahnel11 ай бұрын
  • Thank you so much! Very well and simply explained!

    @go_better@go_better8 ай бұрын
  • This was actually amazing

    @perseusgeorgiadis7821@perseusgeorgiadis7821 Жыл бұрын
  • The content is gem. Thank you for this.

    @hrishabhchoudhary2700@hrishabhchoudhary270010 ай бұрын
  • Agree with the other comments, so clear and easy to understand. I wish all teaching material was this good...

    @jonathanpersson9656@jonathanpersson9656 Жыл бұрын
  • This was incredibly good!

    @Larock-wu1uu@Larock-wu1uu Жыл бұрын
  • Wow. This is incredible!!

    @mbrochh82@mbrochh82 Жыл бұрын
  • Great explanation. Thank you very much

    @KayYesYouTuber@KayYesYouTuber Жыл бұрын
  • wonderful, thank you so much for sharing

    @DavideVarvello@DavideVarvello Жыл бұрын
  • Seems really really cool

    @davhung8004@davhung80045 ай бұрын
  • if there is an Oscar for best tutorial on the internet, this video deserves it !

    @TheAkiller101@TheAkiller101 Жыл бұрын
  • Simply amazing, so intuitive..omg subscribed

    @quantphobia2944@quantphobia2944 Жыл бұрын
  • how is it possible that i’ve watched a ton of videos trying to understand LLMs from the likes of universities and big tech companies yet this simple video in comic sans explains everything in the most direct and concise manner possible !?

    @mmarsbarr@mmarsbarr11 ай бұрын
  • This is a very good video! Excellent explanation on Large Language Models!

    @stanleytrevino6735@stanleytrevino6735 Жыл бұрын
  • What a fantastic tutorial! Thank you! Liked and subscribed!

    @Bhuvana2020@Bhuvana2020 Жыл бұрын
  • fantastic video, thank you!!!

    @eriksteen84@eriksteen8411 ай бұрын
  • Fantastic. Please teach more You are a legend.

    @RK-fr4qf@RK-fr4qf8 ай бұрын
  • Very nicely done

    @LeviNotik@LeviNotik Жыл бұрын
  • Simply superb explanation

    @sumitarora5861@sumitarora5861 Жыл бұрын
  • Really well explained!!

    @magunciero@magunciero Жыл бұрын
  • This is uncut gold.

    @BenyThePooh2@BenyThePooh2 Жыл бұрын
  • Eventhough I knew all this stuff, it is still nice to watch and listen to a good explanation of these fundamental ML concepts.

    @peregudovoleg@peregudovoleg Жыл бұрын
  • This video is a must watch

    @berbudy@berbudy Жыл бұрын
  • Amazing Video!

    @CUDA602@CUDA602 Жыл бұрын
  • Wow .. what an explanation sir ❤ Thank you 🙏

    @sumitpawar000@sumitpawar000Ай бұрын
  • This is really good.

    @theunknown2090@theunknown2090 Жыл бұрын
  • this is gold, thanksss sir

    @pointblank3409@pointblank3409 Жыл бұрын
  • Thanks for the good explanation

    @yourfuneral@yourfuneral Жыл бұрын
  • I loved this. Clarity = real understanding= respect for the curiosity and intelligence of the audience. Requests: Would like more depth about "back propagation", and on to why so many "layers" and so on...!!!!

    @lopezb@lopezb11 ай бұрын
  • Great ! Onto part 2 😃

    @danjsy@danjsy9 ай бұрын
  • Easy to understand explanation of large language models 👍

    @angelatatum8642@angelatatum8642 Жыл бұрын
  • This is so good I’m inspired to go back and learn Fourier and Taylor series

    @_sudipidus_@_sudipidus_2 ай бұрын
  • This is literally gold

    @brandonwashington4422@brandonwashington4422 Жыл бұрын
  • What an amazing lecture on LLM! Loved the example Markov chain model with the bob Dylan lyrics, that was actually a fun homework exercise in one of my grad school courses. This really helped me understand neural networks, which are so much more complex.

    @zeeg404@zeeg404 Жыл бұрын
  • Wow, this video was really informative and fascinating! It's incredible to think about how much goes into building and training a language model. I never realized that language modeling involved so much more than just counting frequencies of words and sentences. The explanation of how neural networks can be used as universal approximators was particularly interesting, and it's amazing to think about the potential applications of such models, like generating poetry or even writing computer code. I can't wait for part two of this video!

    @dylan_curious@dylan_curious Жыл бұрын
  • Thank you, this is brilliant

    @wastethesweat@wastethesweat Жыл бұрын
  • Outstanding!

    @jwilliams8210@jwilliams8210 Жыл бұрын
  • Thanks for showing what a neural network function looks like

    @ApocalypsoTron@ApocalypsoTron11 ай бұрын
  • Omgg are you serious? You have some top-notch pedagogical skills.

    @vaguebrownfox@vaguebrownfox9 ай бұрын
  • Excellent! Subscribed

    @JoseRojasA@JoseRojasA Жыл бұрын
  • Super clear - need to circulate this around my teams adjacent to the scientists at work

    @gregpavlik6474@gregpavlik6474 Жыл бұрын
  • Thanks, what a video, in 8 minutes I have learnet so much, and very well explained with graphics indeed.

    @junglemandude@junglemandude20 күн бұрын
  • This video deserves more views.

    @dragonwisp9810@dragonwisp9810 Жыл бұрын
  • Very easy and clear!

    @user-qd3he1kl6v@user-qd3he1kl6v Жыл бұрын
  • Purely awsome

    @imzhaodong@imzhaodong Жыл бұрын
KZhead