Dominating an Online Multiplayer Game using Python and OpenCV.
2021 ж. 21 Қыр.
273 696 Рет қаралды
Testing the limits to see if we get banned by playing over 30 hours straight. We will use object detection techniques to bot this game and come out on top of the leader boards.
👊You got something to say to me?? Join our discord!✌️
/ discord
💸Want to help support the channel?💵
www.buymeacoffee.com/clarityc...
⭐BAHADIR Original Code Star his Project!⭐
github.com/bahadiraraz/fishin...
💻My Updated Bot Code.🖱
github.com/ClarityCoders/fish...
"I'm no Code Bullet, it will probably work in a few tries" lol ya had to do him dirty like that
Shots fired indeed.
@@d1oftwins bullets fired :P
@@patrickbros4927 oof, that's punny. 😁
Hahhaa
gottem
"The bot would close the leaderboards, for some reason" Sigma Bot confirmed.
P!
@@mateusgraciano3724 ENIS!
Sigma Bot Grindset be like ... "Numbers are inrelevent, grind is eternal!"
As others have mentioned, running in a headless browser would greatly increase efficiency and most like solve browser crashing issues. That way you could also have a bunch of bots without needing to run endless browser windows. I would redesign the bot to read values from memory instead of template matching as template matching is expensive. If I get some time off from work I might do this. Good video
Really great idea. I might do an example this way just to showcase it! Thanks for the feedback.
@@ClarityCoders Honestly, this is an activity I'd do as a challenge: reading data from a browser is pretty difficult considering how advanced they really are. I'd start messing around in Cheat Engine to find out what values you can find locally. Maybe a simpler IO game may fair better here as there are a bunch of variables to keep track of in this one, which would take more time than I would take for a KZhead Video, I'm talking thesis level time. Good luck, I love seeing programming channels like this one to get more people interested in the field.
could the image detection be made cheaper by scanning less pixels perhaps
i feel like the contract was to make a system to detect bots, or some single player offline mode XD
Very possible. I'm basing it off some chats and emails I declined to do an interview.
@@ClarityCoders Why tho? Would that mean legal issues with your current employer or would that task may be too big for you?
@@ChakratosLP I have a lot of other commitments with my full-time job and kids. For my side stuff like KZhead I like to do 100% what I want to do or what people watching enjoy. I don't have a desire to work for another company so I didn't want to waste their time.
Nah they wanted fake players
probably to create more fake multiplayer .io games
bruv, when this game first launched on discord, the first thing I did is play for 5 minutes, and then making a script that could autofish. That took me two days since I am not that good, mostly because I couldn't find the right libraries, but when it did... I destroyed all of my friends at the game. Good days.
haha. This is my normal timeline with games... play for a bit... Get Bored... code some crazy stuff... then quit.
@@ClarityCoders Is there something like opencv but for sound? I think it would be useful to detect audio and either determine the distance through volume or try to determine what side something is on while reading mouse movements or simply using the mouse itself to determine an audio's source direction if not to simply find what kind of sound is playing to react to it or look for something!
@@trevorthieme5157 That's basically how aimbots worked originally, for footsteps to play, the game must first know the location the footsteps are coming from, so if you get those coordinates then you know exactly where a player is.
@@DeusExRequiem That's kind of nuts
Really enjoyed this video my dude , well done. Clear and concise as well.
Cool video! You can send ctrl + w to close a tab in chrome and ctrl + shift + t to re-open the tab you just closed. Add one more thread & class to "reset fishing from start after sleeping X hours" and you're done.
What a coincidence! I came across this python bot in its non-functional form a couple weeks ago and can't believe someone came across the same script and decided to update it so much. Thanks, awesome video!
I'll try this myself the return to this video and see how I did un comparison to you and what can I get better at. Nice video probably! xd
Saw this Bot 2 yrs ago, and I got inspired to learn python, and to use the similar approach, I attempted to use a bot to trade Binary Options, well not for hours like in this game, but I am getting stuck with the computer vision, in particular reading numbers, some are not read well, but the basic functionality is there, thank you for inspiration
Love it, keep up the great work.
Any recommendation on where to start with creating bots? Do you have a particular project or tutorial you recommend? I know some python and have more experience from the data analytics perspective but am looking to learn a bit more about AI/bots including chat bots and bots like this one.
Loving the content
Thank you means a lot! Appreciate the view and comment.
Your videos always interest me because I love to think of how I could exploit a game if I knew how to make a bot to play it for me. More for the challenge of making something like that then actually beating a game. How did you work you way to this level of coding? Do you know of any recourses I could use to get practice coding bots or simple AIs?
You need to learn the very basics of any language from start to finish. I know it's boring but it really takes time to understand a language. Get the basics down and then progress into projects. Once you get into projects take stuff that is already done like this and try to recreate it without using my code. Then when you get stuck see what I did that sort of thing.
@@ClarityCoders Thank you for the guidance!
great video keep up the good work
Thank you! No rest for the wicked I'll keep at it.
Thank you for sharing the journey :)
you should try some with Puzzle Pirates, great fun to think through the puzzles and make the bots
answer me please. in another game. how to force mouse cursor to follow bobber what created every time in new place, every time when you do new cast fishing rod?
i remember doing this tutorial and improving the bot quite alot. i was top dog by far XD
This is sick!
Hey love your channel if anyone hasn't go check it out. Thanks for watching!
Thank you for the video, just a quick question could you use FastAI instead? Can a neural network perform better in this case rather than template matching as you did?
Good questions. I'm sure you could I think overall though it would be slower and not improve the results. The template matching catches the fish almost all the time.
I think the bot contract was to test future improvements. Maybe they don't have a dedicated person to keep testing and your bot would solve it. Then apply AI. And so on. 😉
Yup very possible. I check back on some of my contacts over LinkedIn when we were chatting. Here is the original inquiry. We're looking into some AI/ML implementation for a couple of upcoming features in the game, and seeing what you were able to achieve from outside the box was very cool. It's an area we don't have a ton of experience in as a studio, so just looking to see if you'd be able to give us a bit of a steer! Then the chat went on and I ended up not pursuing.
In the end you say theres a link for your python course? It seems to not be there, at least for me it doesnt show :(
Nice video, I miss the old logo :) What happened to the open CV tutorial series you were making a few months ago? It stopped after two weeks. Will open CV eventually be included in the new tutorial series?
Yes! I am wanting to continue it and will it will! My next video will be the python series than an OpenCV one. The logo change was tough for me I liked the old one but it resembled some other channels so I thought I should change now or be stuck for good.
@@ClarityCoders I look forward to it. I do like the new logo, it's just less obvious what it is for.
can you make bots in rhythm game? I found a tutorial on piano tiles, but it doesn't really help if the game uses different colored notes, I also found a tutorial on guitar hero, but it's too difficult for me to follow because he doesn't explain the code in the video like you usually do.
Sure I'll put it on my list and check it out.
@@ClarityCoders thanks
Noice
If I am not mistaken, Chrome has a feature that closes (or just free some memory) from tabs that have been idle for some time. This feature can be turned off, or you can white-list one or more websites that you never want to free memory
Very cool. How do you get output from it for something simple like number of fish in basket?
Most likely also template matching. So you check every possible number at that part of the screen
commenting for the algorithm
My man! Thanks.
@ClarityCoders any chance of a candy crush type game bot? I would like to see how the math behind something like that works.
If this is a browser game, you might be able to just spoof the server and tell it what it expects to hear. There's no telling how much they put in the hands of the client that they shouldn't have. A common rookie mistake is to assume that data that's calculated client-side can be trusted. It can't. Once that code is running on someone else's computer, you can't trust anything it says.
As other have mentioned, a headless browser is likely your best bet. If they aren't running WASM, you'll likely be able to disassemble the client-side app and find things like the horizontal coordinates of both the bobber and the green bar. I also don't see you needing to move to the shop to sell fish. You can likely just trigger the shop interaction with a special packet. I recommend using your browser of choice to capture the packets from a simple session. Catch and sell exactly one fish and figure out how the client tells the server that it wants to sell fish. (If they were lazy enough, you might be able to just send a 'I sell this fish' packet after each catch.)
2:17 > TrackManiaForever Next vid confirmed? :D
It has been on my list.....
Very fun to watch.
Glad you enjoyed thanks for watching and commenting.
My idea would be to analyze the fish movements over a certain time and try to find some model which describes that movement. Than you can improve the fishing method. For me it looks like that they are not moving randomly.
Wow shots fired. What a fin-ishing move.
He has me on ignore. 😂
Is anyone having problems? I followed the instructions but I am having these problems. 1. it takes a while to open the main advantage 2. when I put the 6 fish together the main lead freezes and goes into a selling loop I have to reopen the main window.
Genius
yo that ban hammer stock clip was hot wtf
Video has something for everybody!
Its good seeing poeple learn and practice coding for games.
What's the fail rate when a fish bites with the bot?
why there's no main window after i completed the installation
I am a begginer trying to learn code and I can't make the "main" little screen to appear. Do you know what could it be guys?
Hey, so i was wondering. If your bot works perfectly fine, and you know it (either you tested it or you're arrogant enough to just "know" there are no bugs [not talking about you, just what i would sometimes do, to my demise]), is it possible to run it on something like a docker container? What i mean by that is to let it think it has screen, and still read data from it without actually having the screen. It kinda feels weird to occupy your workspace for 24h+. And the electricity isn't cheap... Better yet - can it be run in a cloud?
The whole thing depends on reading pixel patterns from the screen so probably not, at least not with this implementation
There are ways to run UIs headless, e.g. via VNC.
Run it in a docker replicaset to guarantee uptime. Now scale might look fishy
seems, intersting! lets learm python!
My man! Go get your learn on.
You really should have more views
Just happy someones watching! Means a lot thanks for commenting as well.
Subscribe, like n share! 👍
@@enlacdmx4379 You the man! Thanks!
why main windows not showing in my case, i use python 3.10
Very cool!
Thanks for watching and commenting!
Nice
Like the videos. Keep it up!
I have an idea for you, why you don't make an AI for twitch chat that learn how to write and meme as the other users and look similar to them?
How do i use this bot?
how to install the bot?
Is this on playstore ? And do you have a link to the game ?
Hi man is this possible with games thats not a browser game, like a game off steam
Yeah would work very similar. I'll try to do one in the future.
I like your channel
It'd be nice see the mouse position and clicks. Also the keys being pressed.
Great feedback. I'll make that change in my upcoming videos.
adamsın bahadır
Using the code on games makes the video educational and interesting. Interestingly enough, this fishing minigame is similar to the one for the new GW2 expansion. It goes to show how it's a pretty standard implementation for a game known for being unique.
gw2 is trash, always has been, and this looks like a rip of stardew valley. Not sure who did it first but fuck gw2 lmao
Can this bot run while i do something else like can i play another game etc or have to be the on top game
Could be changed to run like that.... I might do an update on it.
@@ClarityCoders this would be awesome caz i searched and most i saw was that windows have only one active window and so my mouse and keyboard will be locked to the bot
wow, you are really amazing... You can try the gta5 bot also if you like too.
Thanks for watching! I'll put it on my list.
Next, Axie Inifinity
Could you possibly create a among us bot? Or create a bot that can join any game in Roblox and be pro?
"Nooowwwww its a code bullet video" lol
This game looks so cool wow you should really spend more of your time to dev some pythons and OpenCV code for that kind of sick game, pretty sure it's the futur
Thanks buddy! Appreciate the view and comment.
Could you make some anti bot bots for TF2?
lmao she hit with the side of the hammer
hi i use your code but its not fishing run for 2hr
cool stuff, you could have made some bots for them, don't see the issue although they could actually just do it themselves much easier, no idea why they don't
Just didn't interest me. I actually looked back at my messages and I think they wanted to use my outside bots to test new modes. So run a bot for a few days on a new environment to see any glitches or whatever. Would be useful to them sense the bot is out of house like real players.
what editor is he using?
Visual Studio Code!
Hey can you please help me make a bot for a game on bluestacks
windows system.. lets you focus on what your using it for only.... making soft. Enjoy the journey my new friend!!
turkish game project
13:59 Sam was into something
Wait your video for so long !!
Thank you for waiting! Appreciate the view and comment.
do you still make things like this?
Love itt:)
Thanks! Glad someone is watching and enjoying it.
Unrelated but what was she hitting with that hammer on such a weird angle 1:00
Yeah a couple of people have said that now it's really bothering me.
i wouldn't really say they want bots in thier game to fool people but looking at games that have actual bot for "pve" often they are not that well made because the pvp part was their focus. Pretty sure some company would love to have specialists working on this to improve or add bots to thier games but you could also be right with your not so fair idea. ^^
Very possible!
name of game please
Uses the mic properly, has a boom arm and even a shock mount… but no pop filter? I feel like a step was skipped. Lol :p
In my defense I have one it just gets in my way so I put it in the drawer haha.... I'll get it back out :)
@@ClarityCoders I am probably being way too picky, but I did notice some plosives. I also watched a few of your videos and decided to subscribe.
@@CoolJosh3k Not at all I love to improve so the honesty means a lot to me. I'm still in my first few years of making videos so I need all the help I can get.
bahadır
What about clash royale ? where you need to think which card is better to attack and defeat one enemy?
I've thought about doing one on Clash Royal before! Good idea.
is this still supposed to work? where should you be starting out? i can get to throw rod and then it doesnt manage to catch fish any idea why? is that window suppoosed to show upo showing the green bar for catching? because i dont get that Reset Click. finding Bobber Current Max: 0.8802654147148132 sleeping Reset Click. finding Bobber Current Max: 0.5751792192459106 sleeping Reset Click. finding Bobber Current Max: 0.5751792192459106 sleeping Reset Click. finding Bobber Current Max: 0.5751792192459106 sleeping Reset Click. finding Bobber Current Max: 0.5751792192459106 sleeping Reset Click. finding Bobber Current Max: 0.5751792192459106 sleeping Reset Click.
i did pip install -r requirements.txt AND is says ERROR: Could not find a version that satisfies the requirement h5py==3.1.0
how i can fix it?
You on windows?
@@ClarityCoders yes
@@ClarityCoders i did pip install that thing in cmd. its been loading alright and at the big error
@@ClarityCoders maybe i can show you video in your discord?
*codebullet will remember that*
I'll be waiting. He can't hear me and my 30k subscribers though haha...
I liked this video
I like this comment.
The only non childish use of bots here, is to have them compete against each other.
Bahadır? Türkler kod yazıyor muydu la
you look like dream
Why did you decline that conttrract?
Honestly I am just fairly busy with other commitments and I didn't want another job.
you do know this is against bots? right?
Can you do private tutorial on the code review
he does on his website but it costs money
@@DanDN_ how much
This looks so easy to do with autohotkeys.
Can you please have a go at GeoGuesser? 😀
Impossible.
It is on my very short list of programs. Like really interested!
0:58 that is not at all how a sledgehammer works 😂🤦
Skillz
sheesh need you to make me a runescape bot xD
I've been thinking about it cause everyone says I'll get banned. Should I do the old school one or the new one?
@@ClarityCoders old school for sure! you wont get banned if you 1. dont bot for to long, (8hrs max) i know kinda sucks 2.make it as human as possible 3. most important hide your username I think you got this!
It's bothering me that a lot of these "coders" are looking more and more like the jocks that used to make fun of how smart I was only to turn around and ask me for help doing their school work.
I did my own homework 😂. Although I do a lot of silly projects I do work professionally and have my masters degree. Really appreciate the view and comment.
Stardew valley vibes
You know they could implement a simple captcha mechanism that would wipe 90% of botters. Many of these games should have it.
I think they don't hate the botters as much as people think.
@@ClarityCoders yes, I agree. It's like artifical crowd :) and in most games they keep the economy stable, providing these common resources available for everyone.
On games like this - sure, it would probably clear out most long-time running bots. But.. With that said - captcha is in no way an issue, its 2021, the sheer amount of anti-captcha APIs you can hook onto is amazing. I've previously written small python scripts that passed a captcha that came each 2nd - 5th reload of a webpage, by using -really- simple API hooks and 5$ you can easily clear around 5-8k captchas. On games where items or currency has a real world monetary value, its a -tiny- expense for stuff like anticaptcha.
@@dvmusic5164 thanks for sharing this, makes me wonder, we really should either enjoy the game without worrying about bots, as they're everywhere, or don't play games at all xD
I miss CodeBullet
Same :(