KZhead
Ғылым және технология

100% Local AI Surveillance System - Moondream 1.6B / Python / Mistral 7B

All About AI
2024 ж. 16 Мам.
13 926 Рет қаралды
Жүктеу

100% Local AI Surveillance System - Moondream 1.6B / Python / Mistral 7B
👊 Become a member and get access to GitHub:
/ allaboutai
📧 Join the newsletter:
www.allabtai.com/newsletter/
🌐 My website:
www.allabtai.com
In this video i create a project where I use the moondream tiny vision model and a live stream to detect different objects / persons and send a e-mail alert with the video clip attatched. Python Automation
GH Moondream:
github.com/vikhyat/moondream
00:00 Local AI Surveillance System Intro
00:44 Flowchart
01:48 Python Code
05:24 How to Setup IP Webcam
05:51 FIRE Test
08:10 BOILING WATER Test
09:49 Conclusion

Пікірлер

  • bro, start teaching this kind of stuff to young people in your area and you will become the town hero. I'm not a coder and with Python it is still possible to understand what's happening in the program. Love your vids & your creativity.

    @electromigue@electromigue3 ай бұрын

    • thnx a lot =)

      @AllAboutAI@AllAboutAI3 ай бұрын

    • He is teaching already

      @dawidw.6016@dawidw.60162 ай бұрын

  • You're definitively my favorite channel !

    @FBHearty@FBHearty3 ай бұрын

    • thnx a lot :D

      @AllAboutAI@AllAboutAI3 ай бұрын

  • wonderful job! i'm going to copy this and tweak it to hunt for ufos!

    @scriptoriumscribe@scriptoriumscribe3 ай бұрын

    • haha cool :P

      @AllAboutAI@AllAboutAI3 ай бұрын

  • minimalist wonderpiece, thanks for making this video

    @Ricking0@Ricking03 ай бұрын

  • super cool video. this is basically what the startup Groundlight is doing.

    @nateb.1276@nateb.12763 ай бұрын

  • Love the mountains in the background. Looks like you live in a beautiful place!

    @wildfotoz@wildfotoz3 ай бұрын

    • yeah its cold, but nice =)

      @AllAboutAI@AllAboutAI3 ай бұрын

  • Great videos as always mate! I'm subscribing and liking as much as I can. Btw what kind of camera are you using for surveillance? Do you think something like the ESP32 cams or something similar like the ones running on a raspberry pi can be used for this? I do have a beefy GPU, but my budget for camera equipment is in the toilet. Just wondering. Keep up the great work buddy!

    @bovjer@bovjerАй бұрын

  • Bro, it's so amazing engineer skills, u'r NEURAL VIKING!

    @nerual_dreming@nerual_dreming3 ай бұрын

    • thnx a lot, appericiate it =)

      @AllAboutAI@AllAboutAI3 ай бұрын

  • Great video! 🔥

    @HyperUpscale@HyperUpscale3 ай бұрын

    • thnx for tuning in =)

      @AllAboutAI@AllAboutAI3 ай бұрын

  • you are amazing bro

    @dankoyy42@dankoyy422 ай бұрын

  • Boiling water test was awesome!

    @nevildev@nevildev3 ай бұрын

    • thnx :D

      @AllAboutAI@AllAboutAI3 ай бұрын

  • Thanks!

    @RoombaMaster2020@RoombaMaster20203 ай бұрын

  • Moondream reduces images to 440x440 pixel squares so no point in high res images. It will letterbox them too. If you want to see small objects you might want to break up the images into overlapping tiles.

    @Tsardoz@Tsardoz8 күн бұрын

  • Harika fikirlerle videolar üretiyorsun.

    @enesgul2970@enesgul29703 ай бұрын

  • person of interest vibes ;)

    @MilMike@MilMike3 ай бұрын

  • Love the surveillance app, how would you go about detecting if it was not a family member? I think that would be a terrific extension. Amazing mate

    @craigrichards5472@craigrichards54723 ай бұрын

    • You'd probably have to have a few images of yourself and your family members and train the model to recognise them. Training also may not even be required here, not too sure as I haven't played around with it myself.

      @jackford3069@jackford30693 ай бұрын

  • I've been watching your content for a while, very good and very useful information. You covered something I wanted to know for a long time. Just wondering if open source has software that allows for vehicle license plate recognition and face recognition as well.

    @AlvinEvangelista@AlvinEvangelista3 ай бұрын

    • thnx mate =) if not to sure about that, havent tested

      @AllAboutAI@AllAboutAI3 ай бұрын

    • Yes, check out Home Assistant and Frigate, I believe that is one way

      @Ricking0@Ricking03 ай бұрын

  • Brother you got some skeeeeelzzz

    @ereheryeht@ereheryeht3 ай бұрын

  • Alright I can't take it anymore - ILL JOIN THE MEMBERSHIP

    @test12382@test123823 ай бұрын

    • welcome :D

      @AllAboutAI@AllAboutAI3 ай бұрын

  • Insane! Immediate subscribe

    @widgetman@widgetman3 ай бұрын

  • Would love your vlogs if you are going to do it in future. ☺️🙂

    @IamAshishChauhan@IamAshishChauhan3 ай бұрын

    • i might do that :P

      @AllAboutAI@AllAboutAI3 ай бұрын

    • @@AllAboutAI looking forward :)

      @IamAshishChauhan@IamAshishChauhan3 ай бұрын

  • good stuff !

    @user-ei3fw5ct3s@user-ei3fw5ct3s3 ай бұрын

    • Tnx:)

      @AllAboutAI@AllAboutAI3 ай бұрын

  • 🎯 Key Takeaways for quick navigation: 00:00 🌐 *Introduction to Local AI Surveillance System* - System demonstration of capturing video and sending email attachments. - Brief overview of the system components and flowchart. - Explanation of the IP webcam setup for live streaming. 01:49 🤖 *Mistral 7B and MoonDream 1 Ty Functions* - Introduction to Mistral 7B function for security logs. - Overview of MoonDream 1 Ty Vision model function. - Configuration of video capture settings. 03:39 📧 *Email Function and Main System Loop* - Explanation of the email sending function using the Mailgun API. - Main loop of the system for continuous monitoring. - Conditional statements based on person detection and email sending. 05:16 🔥 *Testing for Fire Detection* - Switching the system's prompt to detect fire. - Live test for identifying a fire in the video stream. - Evaluation of the email confirmation for successful detection. 07:56 💦 *Testing for Boiling Water Detection* - Setting up the system to detect boiling water. - Live test for identifying boiling water in the video stream. - Verification of the security log and email confirmation. 09:54 🎉 *Project Conclusion and Invitation* - Recap of the project, its ease of setup, and successful tests. - Invitation to access the project via a link in the description. - Closing remarks and gratitude for viewers tuning in. Made with HARPA AI

    @Professorfungi@Professorfungi3 ай бұрын

  • Isn't LM Studio sadly closed source? Anyway good video, thumbs up.

    @wurstelei1356@wurstelei13563 ай бұрын

  • Hoping this can be used with zoneminder as well?

    @lbf5984@lbf59843 ай бұрын

    • Zoneminder captures in motion JPEG - basically a series of JPG files that are replayed like a flip-file card deck to create video. So in theory it will work with moondream if you can feed the images to it in order. You'll probably need to code for MJPEG. I gave up zoneminder because it's sooo far behind others, and it's management and performance over time get worse. I had two sites running it with between 2-8 cameras each. It did a good enough job to put some burglars in jail (two events) and held up in court - or at least the perps plead out after seeing the video (which I converted to H.264). But it's not H.264, which has far surpassed anything else. Most cameras do not output HD-quality MJPEG, so using ZM requires either lower resolution images, or a heavy transcode/rip on the server as the HD feed comes in (CPU hog at scale). So it rips the video into thousands of photo frames. Each of those is an inode on the disk, and you'll find yourself tuning them (and the OS) to get it all to hold together. The chain of daemons to capture, rip, "eventify" and store will add up cycles. It is not an efficient design or system. I liked it and ran it for a few years, but I never stopped looking for something else. Eventually I found and tested a few. Take a look at FreeNAS; that is my current selection. It's pretty cheap compared to your labor. But as always, YMMV. Enjoy.

      @FamilyManMoving@FamilyManMoving3 ай бұрын

  • Minimum requirements to run moondream is 6GB VRAM, correct? Sadly can't be run on low end machines yet.

    @akkitty22@akkitty223 ай бұрын

    • that might be correct, havent looked it up

      @AllAboutAI@AllAboutAI3 ай бұрын

    • You can run using only CPU using llamacpp, but will be very slow and you need RAM that could fit the model.

      @fullcrum2089@fullcrum20893 ай бұрын

  • Be honest, was the hardest part of this video the UI introduction part?

    @hilmiterzi3847@hilmiterzi38473 ай бұрын

  • 👓🔭

    @jekkleegrace@jekkleegrace3 ай бұрын

  • Who knew the Orwellian future would be initiated by our own hands

    @ForTheEraOfLove@ForTheEraOfLove3 ай бұрын

    • Interesting take, perhaps it's our only weapon against an actual Orwellian future. If the power is decentralized and into the hands of the people, no centralized organization is viable enough to grow big enough in surveillance.

      @Melvin420x12@Melvin420x123 ай бұрын

    • sucky sucky long time

      @CustomDabber360@CustomDabber3603 ай бұрын

  • nice:)

    @micbab-vg2mu@micbab-vg2mu3 ай бұрын

    • thnx mate =)

      @AllAboutAI@AllAboutAI3 ай бұрын

  • 😅 sir i have a request can u make a video on it like I want to create a virtual assistant with vision so I want to use Llava multimodal . When I start the app then it starts storing frames from webcam and a certain interval then I speak to assistant and when I stop speaking the frames will be stored in a folder and last 60 frames will be stored then after detecting that I am not talking it will take all these 60 frames and stack upon each other and make a one image for convenient then this one image containing all last 60 frames in one image will be sent to the modal along with STT as a prompt and then we will get our response from the modal and speak it using TTS. So I am making a vision virtual assistant that uses webcam ☺️😀 this is my idea can u make it? Pls ❤️☺️🙏❤️

    @lokeshart3340@lokeshart3340Ай бұрын

    • Like gemini demo real life

      @lokeshart3340@lokeshart3340Ай бұрын

  • is mistral even necessary in this structure?

    @rocket-mx6bh@rocket-mx6bh13 күн бұрын

  • the URL discord invitation doesn't work

    @hmoodhsjss7075@hmoodhsjss70753 ай бұрын

    • hmm, ill check asap

      @AllAboutAI@AllAboutAI3 ай бұрын

    • @@AllAboutAI ty, i just tried it and it still doesnt work, the invitation is expired or i dont have permission to join

      @hmoodhsjss7075@hmoodhsjss70753 ай бұрын

  • reolink already does all this cool tho

    @John-ki9fu@John-ki9fu3 ай бұрын

    • sure but mostly person or dog AI detection, this is very customizable and you control the logic, while with reolink god knows where the logic takes place, I can think of 1000 use cases for this.

      @Ricking0@Ricking03 ай бұрын

  • How much to host this in a vps?

    @MrJoaopaulofurtado@MrJoaopaulofurtado3 ай бұрын

    • hmm, not sure

      @AllAboutAI@AllAboutAI3 ай бұрын

  • TLDR: Easy, but you should become a paid member.

    @pastuh@pastuh3 ай бұрын

    • I am a paid member yet do not have access to the github. Suggestions?

      @Mephmt@Mephmt3 ай бұрын

    • just send me a mail or join discord =)

      @AllAboutAI@AllAboutAI3 ай бұрын

  • That literally wasn't a cool video. Glad there was no twist at the end with the phone falling into the pot

    @yoagcur@yoagcur3 ай бұрын

  • So you have to turn pc on all the time to make it work? That's BS

    @user-rn7cp8mr6p@user-rn7cp8mr6p3 ай бұрын
KZhead