KZhead

Machine Learning & Neural Networks without Libraries - No Black Box Course

freeCodeCamp.org
2024 ж. 3 Мам.
400 343 Рет қаралды
Жүктеу

Welcome to this No Black Box Machine Learning Course in JavaScript. It’s a course where we code without using libraries because it’s the best way to learn all inner workings of a machine learning system and you’ll greatly improve your software development skills as well.
The goal in this course is to build a web app that learns to recognize drawings. This is phase 2, where we increase the accuracy of the method we developed in Phase 1. We do this by implementing more sophisticated features and using other classification methods (like the Neural Network). In Phase 2 we also learn about Data Cleaning, Confusion Matrices, Geometry and the difference between Vector and Raster data (pixels).
🎥 No Black Box Phase 1 Course: • No Black Box Machine L...
✏️ Course created by @Radu (PhD in Computer Science)
📁 Data: github.com/gniziemazity/drawi...
💻 Code: github.com/gniziemazity/ml-co...
💻 Ilya's code: gist.github.com/id-ilych/8630...
💻 Neural Network Code: github.com/gniziemazity/neura...
Phase 3 Poll: forms.office.com/e/QTMCLLaV24
⭐️ Other Resources ⭐️
Recognizer we build in this course: radufromfinland.com/projects/...
Euclidean Distance Video: • Euclidean Distance: Ma...
Interpolation Video: • Linear Interpolation (...
Draw the Portal Game Tutorial (Inspired from Dr. Strange): • Doctor Strange portal ...
Why the Circle has the Largest Area: • Why the Circle enclose...
Recognizing drawings via webcam: • Learn Machine Learning...
Self-driving Car Course: • Self-Driving Car with ...
Discord Server: / discord
Scikit-learn documentation: scikit-learn.org/stable/module...
⭐️ Contents ⭐️
0:00:00 Introduction
0:04:07 Phase 1 Code Review
0:23:11 Data Cleaning
0:41:30 Confusion Matrix
1:16:00 Euclidean Distance Marker
1:16:06 Measuring the Elongation
1:39:23 Measuring the Roundness
1:59:20 Vector vs Raster (Pixels)
2:22:40 Neural Networks
3:04:49 Optimizing Neural Networks
3:25:15 Deep Neural Networks
🎉 Thanks to our Champion and Sponsor supporters:
👾 davthecoder
👾 jedi-or-sith
👾 南宮千影
👾 Agustín Kussrow
👾 Nattira Maneerat
👾 Heather Wcislo
👾 Serhiy Kalinets
👾 Justin Hual
👾 Otis Morgan
👾 Oscar Rahnama
--
Learn to code for free and get a developer job: www.freecodecamp.org
Read hundreds of articles on programming: freecodecamp.org/news

Пікірлер

  • Hope you enjoy the course :-) Check out my channel for more things like this, and btw. I'm organizing a creative coding competition (the main video on my channel tells about it, if interested).

    @Radu@Radu8 ай бұрын

    • You could teach backpropagation by using a convolution neural net that clasifies things ( maybe it can recognize digits or letters CNN OCR) , then you can imput the characters or digits from keyboard and the ai will generate the image for that character via backpropagation ( or at least we would see a representation on what the network thinks it represents) Ofc, the most challenging part would be to offer a background of matrix algebra, partial derivatives for gradient descent, activation functions for perceptrons, function composition, and i thing that should be the bare minimum. Anyways, keep doing what you do, i enjoy your work ! PS: i have tried it with cats ( you wont belive the abominations )

      @Alex_Aly@Alex_Aly8 ай бұрын

    • Amazing sir. u are the best

      @jitulteron6542@jitulteron65428 ай бұрын

    • @@Alex_AlyI can teach it also with the same setup from here as well, no need for convolutions... But I don't know how to teach it well at the moment (if I ever teach it, I want to make it accessible). In phase 3 of the self-driving car course (coming in January) I will teach neural networks in an understandable way. I will probably include something about gradient descent, but my main goal is to explain what neural networks can do and what complexity (number of neurons) is needed for different tasks. I feel this kind of content is completely lacking online...

      @Radu@Radu8 ай бұрын

    • Absolutely

      @eduCraft_Academy@eduCraft_Academy8 ай бұрын

    • Doc, you're the best!!

      @BiP00@BiP008 ай бұрын

  • i just woke up

    @pixmadennis9488@pixmadennis9488Ай бұрын

    • Bro same lol

      @robertgonzalez6664@robertgonzalez66649 күн бұрын

    • Me too i didnt play this video

      @negru9513@negru95135 күн бұрын

    • Me too bro hahahahhaahhaah

      @d3nnis61@d3nnis613 күн бұрын

    • Bruh me too.

      @thebogsofmordor7356@thebogsofmordor73562 күн бұрын

  • When I read "without libraries": I was very amazed.

    @LaniakeaArmstrong@LaniakeaArmstrong8 ай бұрын

    • Yes. Finally a proper machine learning study material lol

      @theuniverse2268@theuniverse22687 ай бұрын

    • @@theuniverse2268 I agree with what you’re trying to say, but it really all can be proper and we probably couldn’t have understood much of this unless we saw that stuff prior, maybe

      @FinanceLogic@FinanceLogic5 ай бұрын

    • Was it without library? Just starting watching? Any good?

      @adityabhise466@adityabhise4664 ай бұрын

  • Amazing, I'm excited to learn. I'll complete this course with practice

    @its_mrpanchal@its_mrpanchal8 ай бұрын

    • Good luck! :-)

      @Radu@Radu8 ай бұрын

  • One word for this video , Amazing

    @muhammedendesutku2714@muhammedendesutku27148 ай бұрын

  • I've seen this guy before. He makes really good content! I'm sure I will learn a lot from this. 💡🙂👍🏻

    @TrevorSullivan@TrevorSullivan8 ай бұрын

    • :-)) thanks

      @Radu@Radu8 ай бұрын

  • You are the best Radu. Keep making videos.

    @swoopertr@swoopertr6 ай бұрын

  • Never mind your vast knowledge on various things, I specifically want to thank you for knowing how to teach.

    @aminaleali7161@aminaleali71614 ай бұрын

    • Happy to hear things like this. Thank you :-)

      @Radu@Radu4 ай бұрын

  • Self driving car was a blast... Can't wait to get on this

    @oxynetz@oxynetz8 ай бұрын

    • Self-driving car Phase 2 begins in the second half of September (on my channel) ;-)

      @Radu@Radu8 ай бұрын

  • Will complete because of its "no blackbox" approach. Will get better idea

    @sachinlodhi8542@sachinlodhi85428 ай бұрын

    • Good luck! :-)

      @Radu@Radu8 ай бұрын

  • Congratulations and greetings from Colombia

    @eisenhowerr.guzman5880@eisenhowerr.guzman58808 ай бұрын

  • Thank You ❤️

    @hnnayankumar347@hnnayankumar3478 ай бұрын

  • Thank you for sharing this awesome tutorial

    @mehrdad1068@mehrdad10687 ай бұрын

    • You're welcome!

      @Radu@Radu7 ай бұрын

  • Thanks so much for the tut and I'm looking forward to part 3 of this course. I'm gonna try to implement something similar on a smaller scale to help teach and get kids excited about ML. for reference how could I improve on the MLP for a better accuracy without overfitting? (Ps. Radu you are amazing just for the fact that you are still replying to comments so a special thank you🌟)

    @rasheedsrq9026@rasheedsrq90266 ай бұрын

    • There is one ML tutorial aimed at high-school students. You may find it useful: kzhead.info/sun/hLx7Yd2sfmtrmqs/bejne.html I don't really have tips I could give for avoiding overfitting. At least none I can summarize here as a comment.

      @Radu@Radu6 ай бұрын

  • this is amazing, I finally completed and learned a lot

    @sohamsinghyadav9254@sohamsinghyadav92545 ай бұрын

    • Glad to hear :-)

      @Radu@Radu4 ай бұрын

  • Oh! This is my Wish❤❤❤

    @samuraipiang8203@samuraipiang82038 ай бұрын

  • What amazing Channel

    @ovskihouse5278@ovskihouse52788 ай бұрын

  • Great 👍

    @AdiAdventuresWorld@AdiAdventuresWorld8 ай бұрын

  • Hey, can you also share the link for the part1

    @josephnguyen5337@josephnguyen53378 ай бұрын

    • It's the first one in the description.

      @Radu@Radu8 ай бұрын

  • About node.js, just in case someone is having the same trouble. By default, I'm using the version v20.1.0, but when I run `npm install`, it throws some errors, and the installation fails. I solved it switching to a previous version of node, v18.16.0 (in the video Radu uses v18.12.0, so probably every v18.x.x will work fine).

    @donlaiq@donlaiq7 ай бұрын

    • Oh wow, thanks for pointing this out :-|

      @Radu@Radu7 ай бұрын

  • Please bring the Algorithms 1, 2 of princeton university.........

    @user-sk3gu8fx2g@user-sk3gu8fx2g8 ай бұрын

  • Please teach about dbms

    @fathimaifla9215@fathimaifla92158 ай бұрын

  • I downloaded the starting code as is and ran "npm install" but got an error. Got the same problem in the last video when I couldn't install the canvas package. Node works fine for every other thing I use it for. Can someone advise why this happens

    @edn_music@edn_music7 ай бұрын

    • Can you give more details about the error?

      @Radu@Radu7 ай бұрын

  • 1:18:00 you could use also jarvis algo for the same

    @meganova609@meganova6097 ай бұрын

    • yes

      @Radu@Radu6 ай бұрын

  • Dear channel owners, please provide edited subtitles for all your videos. This will greatly assist people with hearing impairments. Automatically generated subtitles contain many errors. Accurate information is crucial in programming. Thank you.

    @aleksaleks-ff6qy@aleksaleks-ff6qy8 ай бұрын

    • It's a 3 hours 37 min long video😐

      @MarcosLopez-nd8tg@MarcosLopez-nd8tg7 ай бұрын

    • @@MarcosLopez-nd8tg yeah... that's exactly the reason. I spend 1 hour to add subtitles for 10 - 15 minute videos. And it's not something fun :-| can't listen music or do anything like that during it because have to listen to what I'm saying... I'm grateful that KZhead automatically generates the captions, and that they are helpful at least somewhat.

      @Radu@Radu7 ай бұрын

    • ​@@RaduSorry to hear that. Btw great video!

      @MarcosLopez-nd8tg@MarcosLopez-nd8tg7 ай бұрын

    • @@MarcosLopez-nd8tg Thank you!

      @Radu@Radu7 ай бұрын

  • I love freecodecamp courses which is amazing 😍😍😍

    @LalitaPaswan-yq6ll@LalitaPaswan-yq6ll8 ай бұрын

  • Haven’t started the course yet, but I do have a question. Say you have to do it for real, what libraries should you work with to accomplish this?

    @congminhluu5068@congminhluu50688 ай бұрын

    • We do use python's scikit-learn in the course to learn what it can do and we do get a decent result using it. It's a good library even though python has ones more tailored for neural networks nowadays (tensorflow, pytorch, keras). But I doubt we could get some better results using those. Instead, I would focus on tailoring the features. Probably applying convolutions to the pixels would be a logical next step.

      @Radu@Radu8 ай бұрын

  • Can you give me the link of the first section

    @Bright-Great@Bright-Great8 ай бұрын

    • It's the first link in the video description.

      @Radu@Radu8 ай бұрын

  • How do i handle unbalanced dataset

    @pipi_delina@pipi_delina8 ай бұрын

    • We will have a little bit of an unbalance after the data cleaning (not anymore the same number of items of each class). But I don't focus on this problem in the course. But in short... you have to figure out if the data is expected to be balanced or not. If it is, you should probably create a subset of the data to balance it out and then do the training. But if not, you may do more harm than good if you try to classify underpopulated classes... Really depends on the scenario (like if the underpopulated classes are really important for some reason, then you have to do something else).

      @Radu@Radu8 ай бұрын

  • why did i wake up to this

    @nibomonogatari@nibomonogatari17 күн бұрын

  • Coding without libraries is true coding.

    @tim_allen_jr@tim_allen_jr5 ай бұрын

    • :-)

      @Radu@Radu4 ай бұрын

  • 🎉❤

    @ojasvisingh786@ojasvisingh7868 ай бұрын

  • Glad I'm among the first people to watch this video ❤😂😂

    @eduCraft_Academy@eduCraft_Academy8 ай бұрын

  • ❤

    @J_Machine@J_Machine8 ай бұрын

  • WHAT A BADASS VIDEO THANK YOU

    @thecoffeejesus@thecoffeejesus5 ай бұрын

    • You're welcome :-)

      @Radu@Radu4 ай бұрын

  • The data (~5400 samples) is so big that my browser is not able to load the "viewer.html" page ("page becomes unresponsive"). Is there any way to solve this problem?

    @duke_adi@duke_adi6 ай бұрын

    • You can try using less data. Or maybe draw the thumbnails as smaller images 200x200. Those should help.

      @Radu@Radu6 ай бұрын

    • I tried with less data it worked, but accuracy was less . But smaller thumbnails idea is better option since accuracy is more. Thanks for the idea 😃@@Radu

      @duke_adi@duke_adi6 ай бұрын

    • @@duke_adi No problem!

      @Radu@Radu6 ай бұрын

  • Python will do the heavy lifting? this is weird and no way I am missing this video.

    @user-ii5he7tl6r@user-ii5he7tl6r8 ай бұрын

    • :-) yeah, I think it's important to show that a machine learning model doesn't depend on a programming language. And that using the model is relatively cheap compared to the training step.

      @Radu@Radu8 ай бұрын

    • @@Radu yes. You are correct.

      @user-ii5he7tl6r@user-ii5he7tl6r8 ай бұрын

  • I have given thumbs down and said "nor interested" to these videos over and over and youtube keeps sending me here in my sleep. Damn you algorithm.

    @viktoreimar1240@viktoreimar12402 күн бұрын

  • З.Ы: мне бы хотелось найти начало ( у меня всё в виде HDD лежат стопкой на полке :) и пока не возможно их куда либо в монтировать) ...

    @user-vs4lo7ox4t@user-vs4lo7ox4t4 ай бұрын

    • з:ы: у меня дафомин зашкалил когда это увидел :))

      @user-vs4lo7ox4t@user-vs4lo7ox4t4 ай бұрын

  • 30:00 01:03:00

    @sobeidalagrange7129@sobeidalagrange71298 ай бұрын

  • Is there a python version of the course?

    @bondxxx7@bondxxx78 ай бұрын

    • Unfortunately, only physically, at the university where I work at the moment. Maybe someday... but for now I like to stick to JavaScript on the channel.

      @Radu@Radu8 ай бұрын

    • ​@@Radu what is the point of doing ML in Js when you have python and all libs

      @kapalapa1314@kapalapa13148 ай бұрын

    • ​@@kapalapa1314If you want to be a low level coder, that's all you need. Don't need to understand anything.

      @20cmusic@20cmusic8 ай бұрын

    • @@kapalapa1314 check out my explanation at 03:08. But in short... Calling ML library function is pretty straightforward. Almost anyone can jump right in. But what those functions do is very complex. And hard to understand unless you have some idea of their inner workings. That's why this course exists. To learn.

      @Radu@Radu8 ай бұрын

    • @@20cmusic bro, why u are being offensive. I'm not sure that any ML engineer uses js for these purposes

      @kapalapa1314@kapalapa13148 ай бұрын

  • 5.4k views 2 hours ago I'm here early🙂

    @Ka-kz3he@Ka-kz3he8 ай бұрын

  • any one using nature language to query database ?

    @siliangxia258@siliangxia2584 ай бұрын

  • now my gaming laptop is dying while generating data and for feature extration too

    @meganova609@meganova6096 ай бұрын

    • Haha, yeah, it's what happens when you have a while loop doing a bunch of things like that. Games have time to process between each frame. The goal is to update just 30 times per second or so.

      @Radu@Radu6 ай бұрын

    • @@Radu lol master you replied to your student it means a lot

      @meganova609@meganova6096 ай бұрын

    • @@meganova609 :-)

      @Radu@Radu6 ай бұрын

  • Why JavaScript? Why not Python

    @digvijaysinghrajput8092@digvijaysinghrajput80928 ай бұрын

    • I explain why here 03:08.

      @Radu@Radu8 ай бұрын

  • i have a good question?

    @junotlucas1183@junotlucas11837 ай бұрын

    • What is your question.

      @Radu@Radu7 ай бұрын

  • Hello

    @mariacristinaarezzi@mariacristinaarezzi8 ай бұрын

  • JS...

    @AndersonSilva-dg4mg@AndersonSilva-dg4mg8 ай бұрын

  • 2:26:00

    @meganova609@meganova6097 ай бұрын

  • Я 2 года в коме был только начал осознавать

    @freetellurian@freetellurian5 ай бұрын

  • course :-)

    @user-uu9gm5rb3d@user-uu9gm5rb3d2 ай бұрын

  • First viewer

    @AhmedRehan01@AhmedRehan018 ай бұрын

  • First

    @Bradhawk15@Bradhawk158 ай бұрын

  • I am going to learn thia and comeback to gift $100. Now at 0:0

    @NAYY_STUDIOS@NAYY_STUDIOSАй бұрын

  • Друг Я надеюсь что ты не все картинки раздел

    @freetellurian@freetellurian5 ай бұрын

  • No one uses JS for machine learning, it’s the worst you can do. Please add JS to the video title so no one gets confused and no one watches the video. I know JS and Python, so I’m not saying this cause I know only Python

    @okopyl@okopyl5 ай бұрын

    • Thanks for the feedback! I don't have control over the video title... But I argue that since it says 'without libraries' it won't make a difference. I mean, coding this in python is as difficult if you don't import anything. This tutorial focuses on why those ML techniques work, it doesn't try to get things done quickly.

      @Radu@Radu5 ай бұрын

  • p

    @theasianguylokolol8469@theasianguylokolol8469Ай бұрын

  • 😅6th

    @smartcat5989@smartcat59898 ай бұрын

  • pp

    @theasianguylokolol8469@theasianguylokolol8469Ай бұрын

  • ppp

    @theasianguylokolol8469@theasianguylokolol8469Ай бұрын

  • What the foak did i just watch

    @GTFO_0@GTFO_08 ай бұрын

  • Yes, JavaScript libraries suck... but they also exist because... JavaScript sucks. I have been using JavaScript since 1994... I know this for a fact. You're using JavaScript for this because... you only know JavaScript. Sorry, it's just reality.

    @dus10dnd@dus10dnd6 ай бұрын

    • :-)))) funny because this whole academic year I only teach Python and C# at work.

      @Radu@Radu6 ай бұрын

  • @freecodecamp You never cease to impress!

    @anvesh87@anvesh878 ай бұрын

  • I woke up and i was here.. bit why????

    @ChandanKumar-xw8gl@ChandanKumar-xw8gl10 сағат бұрын

  • Nice thank you so much 👌👍🙏🫶🤝✌️👏🙌

    @mahendranath2504@mahendranath25046 ай бұрын

    • No problem!

      @Radu@Radu6 ай бұрын

  • p

    @theasianguylokolol8469@theasianguylokolol8469Ай бұрын

  • p

    @theasianguylokolol8469@theasianguylokolol8469Ай бұрын
KZhead