ANYONE can make a cartoon with this groundbreaking technique. Want to learn how? We made a ONE-HOUR, CLICK-BY-CLICK TUTORIAL on www.corridordigital.com/
Watch the full ROCK PAPER SCISSORS anime on Corridor ► • ANIME ROCK, PAPER, SCI...
This project has been a huge labor of love, and it is due to the amazing open-source community that we have this technology available to us. We hope that by sharing our discoveries and techniques that we can help push this technology forward for everyone. If you want to dip your toes into this tech, there are many amazing online communities ready to help teach you, including ours!
With Your Support, We Can Make More! ►
This project exists because of the amazing members of CorridorDigital, our INDEPENDENT STREAMING PLATFORM. All memberships begin with a 14-Day Free Trial and you can Cancel Anytime. Consider becoming a member yourself! www.corridordigital.com/learn-...
Anime Rock, Paper, Scissors Shirt?! ►
Available only until March 6th, we have a limited-edition Anime Rock Paper Scissors t-shirt and longsleeve design to celebrate this release. Check it out here! corridordigital.store/
Design by Kendrra Thoms kendrrathoms.com/
Gear Used ►
Puget Systems Computers: bit.ly/PC_Puget_Workstations
Lighting by Aputure: bit.ly/CORRIDOR_LIGHTS
I see a lot of concern, especially from animators, that tools like this will eventually make them obsolete. This isn't a replacement for someone that knows how to animate, nor someone who can draw. Tools constantly evolve, but making something visually captivating always requires those same core skills. It still takes an artist to make art. That hasn't changed. What we figured out here is a very advanced form of old-fashioned rotoscoping. Animation takes a lot of forms; Traditional, 3d, stop-motion... They all have different strengths, and enable different stories. Our method here isn't a replacement, but an attempt at something new. What excites me is that this tech makes it easier to bring my visual ideas to life. Ideas that were otherwise impossible. When I said this democratizes animation, I'm referring to the near-insurmountable mountain of work needed to make a full-length narrative animation. Currently that requires large studios and large budgets. Doing it on your own is nearly impossible. But I see potential in these tools to change that! That's what I'm so excited about. Imagine one person, or a few friends, bringing their crazy ideas to life. Imagine if a traditional animator could automatically have their drawings inked and colored. Imagine eliminating the uncanny valley on cgi faces. These tools have the potential to do that. We're trying to figure out how, and sharing our journey. If we want community-controlled AI tools, we need to develop them as a community, otherwise they become proprietary tools locked behind a company. And yes, this can be done with your own style. We trained our model, not from hundreds of artists, but from ONE film- Vampire Hunter D Bloodlust. We've been very open about this, and I think it's important to be. But this is also an experiment and a loving parody of this era of anime. I consider it no less ethical than the countless other videos on our channel that borrow from pop culture to tell their story. Sudden change can be scary, especially if it feels like your passion or livelihood is on the line. But that's why we're out here exploring it. Hopefully we can help shine a light into the fog for everyone. -Niko
People will just adapt just how engineers are using CAD programs nowadays instead of doing it with a pen and paper.
@@laurenswintek895 Bruh this saves millions in costs and enables a solo dude like you do it on your own. How is that pro big corp ? It's literally made to help the tiny guys that don't have studios or equipment.
Ty
Please don’t let the haters get to you guys. I’ve watched your videos for well over a decade now and seen you all grow into adults with children for peat sakes. I feel old just reminiscing. I can’t help but have a sense of fear for the future as an artist but I am excited to see what you guys come up with next. ;) btw this comment section is filled with trolls pretending to be people who care about artists. Please for your own sanity just stay up here.
@@Lemosa3414 saving millions at the cost of the software literally building it’s foundation off of stolen art and talent. no matter how you look at it, a lot of ai tools relating to art creation is based one some type of engine that was trained off of art that had no consent to being used. we cannot look at this in a positive light until work from artists that were stolen has been acknowledged, reimbursed, and evaluated.
As an animator... this scares me. I've dedicated my life to draw and know how to recreate motion within the drawings. Only to be replaced in a couple of years.
exactly. every time i see someone endorsing ai imaging my dream of being an animator dies a little
as an illustrator I totally feel that. At the moment I'm too aware of the possibility of clients just replacing me to be excited about the tech
I don’t think traditional animation will become obsolete, it may just be considered as a different style. Look at the painstaking hours put into stop motion. There’ll always be appreciation for traditional techniques
It's not like everyone will be able to create full cartoons just with couple of clicks though. Look at search engines: those didn't kill marketing. There's still a skill and expertise required to make a webpage properly indexed by search engines (and there are whole courses to learn SEO, it's not just a 15min tutorial). Just look at Sam's list of prompts he used. It requires time to learn what works and what doesn't.
It's another tool. But it still requires the eye of an animator to do it right.
I felt a great disturbance in the animation industry, as if millions of voices suddenly cried out in terror and were suddenly silenced. I fear something terrible has happened.
Eh...
Wow, very dramatic. Terrible? I think you've missed the entire point of the video.
This is the future inevitable and never ever going away not this time no US law can stop this
The way of AI can lead to animations some may consider... unnatural
@@MrForestExplorer star wars quote
As an animator myself, this doesn't replace animation at all. It's another tool. There is now just one more new style. Painting moved digital a long time ago and cameras have come a long way and yet there are still somehow people buying and selling brushes and canvases painting portraits the old-fashioned way.
a gun's purpose was for hunting and self defense and look at how that turned out, you're putting a lot of faith expecting people not to abuse this
@@lawgx9819 I understand that you believe that opening up animation to more people will cause mass deaths, but I disagree. However, not to get too political, I do think that if the government begins regulating animation, there will be massive problems for people trying to survive in an ever-changing world.
@@lawgx9819 Really don't know where you got that idea from - military use has always been the preeminent driving force behind firearm development, going back to even the earliest examples like the Chinese 'fire lances'. Hunting? Self defense? With advanced technology? That's not something that the poor ever got to do lol; outside of military use, firearms were toys for the wealthy over the majority of the history of firearms. Being affordable and accessible to the everyman isn't something that happened for a LOOOONG time.
The difference in it being a “new style” compared to a replacement is in how the medium is being used. Making AI based anime by essentially rotoscoping live action won’t be seen by big companies as a fun style but instead cheap and easy to manufacture product. Truth be told there’s nothing wrong with live action, I even find the live action version of this video to look better than the “anime” one but simply putting what can be called a filter over an existing product shouldn’t be glorified as a new tool since it doesn’t serve to make a process easier, it just alters something that was already made. Actual advancements using AI have been made such as Cadmium which is a program that uses a persons work to help color in their animation. That’s a tool, it’s helps make an already intended project easier. If you want anime made there’s nothing wrong with just admitting to yourself you don’t have the skill or time to learn. I’m not gonna make tools for a painter to be good at baking, that’s what a baker is for. TLDR: Basically anything can be technically called a “style” but the actual application provides a cheap way to recreate other peoples work without actual work or talent in the field. Wanting to make anime with no care for the creation of anime is an incredibly ignorant mindset
@@jasonparada9596 I understand that you believe cameras (which I would consider a new style of making a portrait), really aren't a tool and that it takes no skill to use them. Only classical painters are the real artists eh? Electric hammers aren't tools either I guess and big companies or builders won't see them as such either. Maybe we should all just quit this new Photoshop "fad" since it will kill jobs and be seen as a cheap replacement instead of a new skill or style. To be completely honest, while I enjoy new styles like this, or Pixar, or old-school Anime for that matter, I also appreciate Disney's style, but still I appreciate claymation. There is room for all of it and the new stuff that'll come after. If anything it'll encourage innovation. Can't keep doing the same old thing and expect it to be tops forever. Just today though I saw someone killing it hand shadow puppetry doing stuff I've never imagined possible.
Around the 17:00 mark he says “Anime has no 3D camera movies”. Close to every modern anime does, even slightly older ones like Death Note had spinning 3D cameras in moments.
Akira comes to mind.
The next time you invite animators as guests, you should show this to them and get their reactions
I think they wouldnt like it that much Since technology basicaly steals their jobs Edit: jeez so many replys 😭😂 I do agree that that kind of video would be cool to see But i as a digitital artist personaly dont like ai "art"... at all :/ I dont think that the ones who dont agree with me understand how frustrating it is
it would be a good idea, maybe their larger audience would finally see them talking about the ethical and moral implications of using AI -based on stolen and unethically sourced work cof cof- seems like they only talk about it on podcasts
I don’t think they would like it, trust me
@@alexanimatess5552 Not... yet... this still looks very rotoscoped and the movement isn't stylized enough. Having said that... it's clearly coming. This might take the jobs of lower skilled animators like those who work on most anime, etc.. It's still a ways away from taking the jobs of people at Studio Ghibli, Disney/Pixar/ILM, etc.. Like I said though... I do smell the wind turning and this taking even a lot of those jobs away. Not all of them, but certainly a significant amount.
Ever watched Father Ted? Theres an episode where the woman who makes tea gets shown the new tea maker. I have a feeling it'd go the same way
I have the feeling "designed by human" is going to be a trademark soon
it seems that this will happen soon, and "designed by human" is simply a sentence, anyone can just lie about it
It's like "artisan" food; while it means something, companies just take the word and use it however they want.
A trademark is a protection of IP. How is "designed by human", as a phrase, IP?
The silver lining in all of this is that, hypothetically, AI-free Art will be more valuable and thus artists could actually make more money
@@viewsfromcairo How would it become more valuable? In order for that to occur, supply must lower while demand increases. Will demand increase? Or will there simply be more art? Will supply go down? The same number of traditional artists exist. You could argue AI art will cause more artists to give up but that's not really guaranteed. As it stands, most artists don't make a livable income off their art. They do it not as a career, but as a pursuit of life.
This is *not* animation. I think its very important that we make that distinction carrying this conversation forward. In order for something to be animation, the baseline prerequisite is that it must be animated. This is simply another incredible example of what the Corridor Crew does best: VFX and Post work using AI.
Rotoscoping has been around since the dawn of time; we've seen it from Bakshi's Lord of the Rings, through A Scanner Darkly and more. While the ability to convert oneself to a 'drawn' character is super cool, no ifs ands or buts, there's a world of difference between animation as a medium unto itself and then just having rotoscoped content.
This is a very different concept considering it literally can’t exist without art to plagiarize.
@@Potterphilly13 it doesn't plagiarize anything... The models don't store any art
@@TragicGFuelyou do understand how ai art works right? it goes through segregated images and copies patterns it notices and tries to fill those in the best it can through either preexisting images (like the ones seen here) or by making something “original”, and either way it’s stealing.
@@jico5147 patterns or art styles are not ownable materials. They're not under copyright. That's whu two people can draw an apple in the same art style and not sue each other. Also, your explanation of AI's working tells me you don't have a clue on how it works beyond the layman's explanation. Which explains why you think it's "stealing"
@@TragicGFuel no i know it’s stealing because i’ve seen real artists use it and explain how it works, this is literally how it works. it copies patterns it picks up from whatever it’s told to copy off of. i don’t think you understand how ai art normally works. in this case this artwork just takes art it sees, copies what it sees, and applies it to the frames of the footage, it’s how you get things like inconsistent designs and patterns. it’s literally just copying whats seen and outputting whatever it thinks is correct. i also never said anything about copyrighting art, though ai mystery meat cannot be copyrighted, while real art can.
What’s so cool about this is that when I was younger I honestly thought cartoons were made from actual videos. So in my head I believed that when I was watching YuGiOh they actually filmed everything first then drew over it
That is a real animation technique but it is rarely the final product. I’m pretty sure they did that in the Lord Of The Rings animation for a few scenes.
That's how they made fire and ice
lot of companies make a 3d animation and draw over it cause 3d is easier than hand drawn also they use stock footage like martial arts and stuff to get the fluid movement so you are quite close
Miayazaki used that style of animation in some of his work! Like in Castle in the Sky there's a scene of a brick wall getting broken, and it was a real brick wall they filmed and drew over.
Rotoscoping?
Disney absolutely salivating about all the animators they won't have to pay once they get this tech sorted...
A.I art can't be monetised, you're scared for nothing
Yeah, they'll have to pay actors and VFX artists, alongside people who specializing in managing this tech to oversee each frame instead.
@@xymi3083 says who? It curretly can't be copyrighted, but bo one is stopping you from selling it.
Why just them? Wouldn't any company be tempted to do so? Even *normal people* are publicly embracing it, so it's not companies. It's society.
@@xymi3083There’s a person on DeviantArt who gets paid for it.
This has made me consider copyrighting in a creative way I hadn't thought about before. If AI copying a style from human works becomes the norm, I'm worried new animator styles won't have a chance to develop because studios would rather not pay for staff. One of the things I love about anime is when you see a key animators style pop that sometimes doesn't even match what was the norm for the show. I'm thinking of that episode of samurai champloo where Mugen gets super high. While I see this tech could help a vision get made, it does so by copying previous works for the style. I'm worried of the long term implications of that, since we may see less new creative styles.
Yes these people dont give a thing about it
Honestly I think this new tech actually does the opposite. Is usually easier to stick to the same artstyle then it is to not only create a new one but to teach an entire team of dozens or hundreds of people a new one. With AI tools in the future, you'll not only be able to easily switch between artstyles, you will also be able to mix countless different artstyles. It is like the difference between being limited to the paint dye that you could locally source pre-industrial revolution, to having access to every color imaginable in the digital age. You can create a pretty much limitless number of artstyles by combining old artstyles. But on top of that it is easier to incorporate new artstyles since you only need to draw a few examples, and it can be learned and applied by the AI pretty quickly. Its easier for corporations to justify being ambitions, when it becomes cheaper/less time consuming to do so. It's also important to remember that new artstyles that people creates are effectively combinations of existing artstyles anyway. There isn't really anything new under the sun, just creative ways of combining the same elements.
Very clever point, this could mean that we’ll not have an emersion of new styles and works of pure creativity. Not gonna lie we better regulate the shit out of this tech.
When you have to do something badly for so long to be able to do it well, this alternative says why bother? It's a discouraging obstacle to new artists
Feature extraction should be a criminal offence, the rich like this shouldn't be using feature extractors to steal from poor and ethnic/minority artisans. It's basically technological classism, or rather fascism with a touch of ruthless social darwinism.
This isn't animation, this is rotoscoping.
“Rotoscoping is an animation technique that animators use to trace over motion picture footage, frame by frame, to produce realistic action.”
@@legolorian3271There is not even tracing in this, so calling it rotoscoping animation is even a stretch (as the artist has to make important decisions about form, weight and movement if you are going to make rotoscoping with any artistic merit.) this is "Anime" in the same way a Snapchat filter is anime. In the end, it isn't animation at all, but what they are good at: Video editing, VFX and post production. Calling it animation is extremely offensive to those who have dedicated their lives to the craft.
@MelloCello7 😭😭😭🧂
As somebody who just graduated from college studying 2D animation; this video is pretty scary. It’s so impressive but it takes away years of progress that thousands spent their lives doing
Have drawn animation will never be replaced. It just has a different feel that I don't think can be replicated fully. In the future, who knows but I feel there will be a place for them for a long long time yet.
@@FullMetalAtheist it will. In the next 3-4 years at most, someone with just a single high-end RTX 60XX card will be able to ask an AI model to create entire anime series in just a few dozen hours (or a few hundred at most depending on the size of the project). You could have it use a source like a Light Novel, Manga, or even an original anime, and ask it to make an adaptation, a sequel, or even a remake for it. It will be able to make everything from story, to sounds, voices, and of course the art/animation. Also, have it come up with original stories based on your preferences will be entirely possible. The same will be possible for movies, and early in the next decade (because of the sheer size, complexity, and required processing power) even entire games.
@@OnigoroshiZero this is the same argument I see for guitar amp sims... there has to be an original in order to emulate... there can be no output without input. The beauty in animation is the vastness of styles presented by different artist and if they all just copy the same sources then they will all devolve into the same style and no one will want them.
@@OnigoroshiZero i truly hope you are wrong because that sounds like hell
@@OnigoroshiZero Possibly but I have accounted for that in my statement. There will always be hand drawn animation, it's like how everyone thought practical effects in movies would be totally replaced by CGI, yet practical effects are still in use. CGI is common but there still exists a market for practical effects. I think there will be different markets and some may use AI enhancement to create things but there will always be those who animate by hand.
I'd be interested in seeing animators react to this.
We are all concerned and amazed at the same time. Amazed a small production can put together something that looks so good. Worried because it devalues our craft we've dedicated our lives to learn.
As a animator, i think more tools means more options.
@@PikaPeteypeople who used to make typewriters lost their jobs when PCs became widespread, now everyone on Earth uses PCs and they have given jobs to billions of people. If skynet doesnt happen this will be a positive thing for humanity i believe.
@@PikaPetey there is no doubt in my mind that normal animation and art will always have a place.
@@MumboJumboZXC Things like GarageBand and other such programs haven't gotten rid of musicians using actual instruments, not in the slightest. So I think traditional art will be fine
I know there are a lot of other comments here that start with “as an animator…” but As an animator, the whole speech about “democratizing animation” is at the very least, inaccurate. You don’t need a big studio to make something cool, all you need are the knowledge and skills required and an iPad with any drawing/animation program. Animation is a learned skill like riding a bike or playing guitar. If you learn the skills, all you have to do is put aside the time to create your vision, No art theft required! I just hope this gets used as another tool for animators rather than (like this video implied) a full replacement for us.
There's a level of objectivity to art determined on the basis of the highest common standard set in any field. Consider playing a guitar, you could play the guitar like an absolute amateur chortling and clanging away on the strings but everyone knows that doesn't make you a "guitarist". You could recreate motion on a surface but doesn't make you an animator without a certain qualifying standard having been achieved. Art has a harmonious form to it, if you cannot achieve it then you aren't creating Art, you're merely churning out garbled permutations of information.
I think it's a gray area... There's a lot to be great use for Ai mainly in the health and medical industry however for the Arts and Entertainment Industries that's where the gray comes in. I can see where it can be useful however I completely validate the fact that people mainly artist will feel competitive with AI and might not beat that competitor. Studios and Hollywood in general is about making money and seeing how The Writers Guild Strike is going and people wanting more proper pay, I can see Ai being the cheap alternative and since it's new many people will go to it. So I validate the fear and nervousness for artists going against AI and it upsets me that with such a useful tool that can be used for again Health and Medical purposes it's now becoming a trend used popularly for social media and dipping into the Art and Entertainment Industry.
I agree in some areas but i do still think there is a world where we can have cool things like this, and more traditional art.
As impressive as this is, it's scary when you realize a lot of animation companies might take advantage of this and use it as an excuse to put a lot of people out of a job.
exactly my thoughts
As an aspiring animator, I couldn't agree more. I love innovation, but not when it can completely substitute, or steal an entire group of individuals life skills. Especially one that still requires a lot of skill and understanding of art from even its basic forms. A.I. art and animation is a fascinating tool, but I feel it really increases peoples NEGATIVE perspective that art is just some push of the button or filter. As if it wasn't a real skill that requires years of training to acquire the talent to make everyone's favorite "funny cartoons."
@@jkrwhy It did, but now it won't require years of training anymore.
Then the companies will show themselves as enemies of the workers. They must not be allowed to create massive poverty for profit.
Are you guys also upset that 95% of the population aren't farmers? Or does it only bother you when it's the thing that you invested time into has a productivity tool that allows others to participate?
This is a really unsettling video. I'm in animation school and there's a big fear of exactly this depriving the industry from respecting animation for what it is. Animation is respected as film so little already, stuff like this only makes it worse.
There's so much more to art than the end product. If that's all you're worried about, I'm afraid you'll forever question the field of your choosing.
@@RodasAPCTV they fact that people only value the end product is the issue here. artists have been exploited for years, this will only make it so that art, and any creative job, is less valued as a whole. that's a valid concern.
@@RodasAPCTV They're not concerned about the end product. This "style" of animation just makes it much easier to animate without creative hands. Many animators will have studied, for nothing. COMPANIES care about the end product, and don't care who they step on to sell it to the public.
@@RodasAPCTV you awnsered the issue and why ia "art" is bad yourself
embrace it, use it as a tool. it will enhance ur work
As an animator I'm not afraid of this AI technologies, actually I'm kinda glad, because I use them to make my work less loaded and more easier, we as animator know that this career is exiting but also can be life consuming, like crazy. This tool will not replace animators, not now, because the level of complexity and detail demanded by the clients is something that this techonology can't achive, at lest not know. To get the exact result that is in the mind of the clients/persons in general, you still need hands. Even midjourney can't acomplish that, not now, maybe in the near future. My advice for all animator, adapt to the new technologies. In the future the probably the job offers will be like "experience in this ai needed" so we need to adapt.
No! You are wrong! This will be used to exploit animators more. Watch Mother Basement video about it. This won't make your work easier. This WILL REPLACE YOU.
@@arnowisp6244 Yeah,I don't think so. But that's your opinion
@@arnowisp6244 lol dude stop listening to that guy, he's the typical soyboy woke fear monger. E;r already left in evidence what a clown he is. I wouldn't take what he says as reference for anything
@@arnowisp6244lmao, imagine telling a field expert their opinion in their field of tech is wrong.
@@Deedo_67 Yeah, a random person in the comment section who has little credibility is as much a field expert as I am a surgeon. Are you really that shallow?
19:01 when i saw the short i was kinda worried that now that this has become like common that would affect negatively more independent artist...but while watching this making off i started shifting towards Niko's idea...and this here gave me validation. Because normally only big teams were able tu pull stuf like this off, like, it was reeeally hard, but now any artist on a small team can do this with enough dedication.
yeah the other problem will be that it will be flooded with animation because everyone with a bit of money and know how will be able to make it devaluing animation exponentially to almost nobody is gonna see your work, it's hard to see the tree in the forest kind of situation. and from there it's back to who can produce the best quality work again and that will go back to money and man power.
@@bobxbaker We could probably have said the same thing for cinema with the spreading of low-cost camera, adn the development of platforms like KZhead.
@@blade7y156 yeah, and i watch youtube more than tv and movies combined, look the economical standpoint changes when new technological advancements happen, all the commercial prints used to be hand painted, there was a lot more work for those who painted before it became obsolete. still people paint because it's a fun hobby and it's still a good pillar to understand visual interest, but do you need to paint in order to be a good artist anymore? not really, and look even if we do the most sought after art today is digital art made on a computer. and the whole painting process have been revolutionized aswell even if we were to hold it in high regard, it's not quite the same as it used to be. photography and digital softwares have changed the game immensely.
@@bobxbaker You need to paint to be a good painter though. In chess AI have already destroyed humans so much we could never compeat, and yet there are more chess players than ever, more great players than ever, and almost all of them use AI. The point is not whether or not it will change the field, because obviously it will, but whether or not it would make the field disappear, and I think not.
@@blade7y156 nothing that is enjoyable will disappear, wether you can make money doing it or work the same way you used to is always subject to change. but with that said, there will always be someone who appreciates what you do if you do it well enough. my point is that some people will not have a job or have a drastically different job description for the same work they used to do. but then again when you go into any artistic field you can't go into it expecting to make money.
I love how we are in a time where, "It's designed by a human" is actually a selling feature.
I replayed that bit. Felt like a futurama gag
Handmade was a selling feature for over half a century now
But the image taken is AI, fed by screenshots of the anime.
@@michalslusarski usually the word "handmade" indicates higher quality but in reality it tends to just be pricier.
95% of it was all done by a human??? are you kidding me.
I'm so excited to see where you go with this
Nice video
great
Hi
Nice
Nice
Just wanted to say…I’m watching this vid because of the haters. I wouldn’t have known about this video if it wasn’t for them. Lol. So their hate has shown me something very exciting! Good job. I went to the school of visual arts in Manhattan shortly after the Little Mermaid Disney movie came out. I learned how to hand draw and film each individual drawing. Then computers came along and put an end to that. So to all the haters…get over it and dry your eyes. You can’t stop the future.
the ppl still can be drawing on the screen (digital) its just being a tool for the artist, why did you stop? you were afraid of the changes?
I recognize that this is an evolution of the medium using technology, akin to how Pixar leapfrogged digital animation,but it does put into question how the art form of making anime or cartoons is lost. In terms of commercialization and mass production of animated output is concerned, this will be an effective tool. But it does add another knife on the back of an already heavily injured art form. IMHO But cool tech😊
I find it baffling how a month ago, Jake gave a very in depth video regarding ai image generation and the "fair use" of it during the yet to be decided lawsuits, but corridor still releases this video basically showing they used vampire hunter d, a copyrighted series for training(with ads on the video), and the actual video on a for-profit basis
I guess they better hope they win haha
literally all anime back in the day looked like this. they don't have a copyright on generic 90's anime art styles... also the entire thing is free on youtube
@@retardedmonkey9000 The lawsuit is about if AI being trained on copyrighted material is a violation of copyright law. It was never about what the AI-generated images or training images look like. The images they trained the AI on are copyrighted, and that is all that matters.
I would say it's fair to use the style !
I'm sorry burst your bubble but I'm pretty sure you can't copyright an ART Style.
With the recent rise in your guy's AI videos, we've heard about the Law side of it, and the possibilities that you guys have shown, BUT I would really love for you guys to get a bunch of animators and artists on to talk about it and the future they see it bringing because as a group, they are the ones that will be most affected by this development. Hayao Miyazaki himself from Studio Ghibli has expressed his distain for it (which is why I was shocked to even see a Studio Ghibli scene referenced in this video), and I think if you guys are peddling it as a future resource so hard, it's really important you also express the views of the other side of things. In this video especially it felt like you glossed over that by going "We got it from an anime which is free on KZhead" but that doesn't necessarily mean that those original artists gave you permission to use their style for this project. You have animators on react, would just love to see their opinion on the stuff you've recently shown.
Agreed 100%.
exactly. they're gladly helping animation as a medium get killed off and replaced and pretending that this means "democratizing the medium". such bullshit. i'm so disappointed. had to unsubscribe
exactly. every animator i know is terrified of the implications of ai art for their field. this video just solidifies it. im pretty disappointed in these guys actually
Yeah, i agree. The result and the problem solving definitely looks impressive , but it was disheartening to hear them casually mention using Vampire Hunter D's style ( and that movie is insanely and lovingly animated by a lot of skilled animators that came with that style and put hard work in each frame. ) and just use that template to spew out anything in that specific style. Then again, for all the fun content this channel provides, i remember them hyping up NFT's so I don't have high expectations when it comes to their judgement for the moral/ethical use of new tech. Of all the mundane hard things we could use AI for making our lives easier, we decided immediately to use it for art "shortcuts" , forgetting that half of the fun as well as the knowledge/experience / growth as a creator comes from going through all the creative processes - ups and downs and everything. Well, can't wait for the inevitable AI mish mash of every franchise/art style flooding KZhead.
@@andrewreynolds912 the solution is literally just them being asked if they want their work in the dataset. It’s not that hard. Several of these AI already allow you to issue a request to have work removed from the set
How is this going to "replace animators"? Rotoscoping has existed for decades, but animators are still around. This is essentially just a more niche version of rotoscoping. There's also some time and effort intensive areas this method requires that traditional animation doesn't require - building the image generation model to only generate in one style and distinctly recognize three different people, costuming, choreography, filming, building the setting in Unreal Engine, and running the film and the background shots through that model.
Stable Diffusion was released in August 22, 2022. EIGHT MONTHS AGO! Chew on that. This was they did with a Tool in development 8 months ago. 8 years and you'll be soon Obsolete. And animators are already using Unreal Engine especially for 3d animation. You animators are doomed.
Im pretty sure that its gonna be similar to 3d + 2d animations where you tweak what looks weird, make things look more interesting and I could even see it being a big fusion where you animate the character with 3d to show more interesting camera angles perspective, ai to make the scaffolding of the character, and 2d to tweak what looks weird and add smears and exaggerated expressions.
Vampire Hunter D is one of my all time favorite works of animation. Specific artists created it. It's not "generic 90's anime" house style, as I see a lot of people in the comments saying. The designs are by Yoshitaka Amano, who is a world renowned artist whose work is instantly recognizable, and the animation was directed by Yutaka Minowa-- if people are praising the look of this AI generated style, I hope they realize that it has a specific source. If machine learning is going to be another tool in the pocket of artists, then the creative labor of artists can't be treated as a free resource. For instance, nowhere in the CC video is the original source material credited; Yoshitaka Amano and Yutaka Minowa are not listed under the "artists" section in the description. The modelers who made the 3D assets ARE credited, but not the animators and artists that pioneered the style and produced the *entire work* CC used to train the AI. Calling this work "Anime Rock Paper Scissors", rather than "Vampire Hunter D: Rock Paper Scissors!" or something similar, totally erases the origin of the material, and the subtitle of "Making Our Own Anime" is disingenuous on multiple levels. I remain excited for the possibilities of this new technology, I do think it'd be very cool to train an algorithm on an original style-sheet I made *myself* or by another *paid artist* hired for that purpose, but this right here is theft. It's fun to look at, and I appreciate deeply that there is a baseline level of artistry and film making craft necessary to create it at all-- but I feel like CC hasn't even followed their *own* cautionary advice about AI art and respect for intellectual property on this one. You haven't "democratizing the animation industry" by filing the serial numbers off of the work done by actual animators and repackaging it as your own merchandise. I think there's definitely a world where automated machine learning tools are used ethically to aid in the creation of original art rather than just digesting and reconstituting existing work, but that is not the precedent being set here.
It’s so crazy this happened bc the day before this dropped I watched that movie and fell head over heels.. then this happens
They are literally no better than people using a picture for commercial purposes with "I found it on google so it's free to take, right?" So disappointing.
I think they are real fan, using “generic 90s anime” is “dry British humour”. I’m sure they know who Amano is. (I have several of his art books)
@@pyropulseIXXI no, no they literally wouldn't... That's the whole point. There is literally no difference in them using the ai or if one of them sits down for two years, studies the style and then hand animates every scene. They don't have to pay to "original" creator or have to give credit to him/them because you can't copyright a style/color/method only individual art works. Even better, the only way the original creator would have any legal stands for compensation would be if they used the title of his work in thier title because then they would imply that they have anything to do with that creator...
@@kilor78 I think the point is those of us studying hand animation already don’t like the idea of a machine talking our jobs. It’s salt in the wound that they learned off of our work without compensating us.
Fun fact. Vampire Hunter D Bloodlust has over 180 people credited as members of the animation department. Just wanted to throw them some credit, since the whole conversation of democratizing this technology didn't make any mention of just how much work went into creating the original art this AI style was trained on for free.
AI bros usually wave off the negatives of AI, cuz if there are no issues, then the positives conveniently outweigh the negatives. "AI isn't gonna replace you guys, it's just a tool!" Like, mate, computers didn't do 90% of the writer's job just because the keys were different from the typewriter!
@@Fr3k3 well then something like chat gpt was trained on tons of text. Suppose we'll have to give credit to the entire humanity for making a.i learn language, possible. Same argument. What i see with these a.i tools is that the market wont be as saturated. Great artists will be noticed more as a lot simply give up. Also theres always going to be some niche need for human made art its not the end of the world. Its just that art by hand will need to be in the top 1-5% of artists in the world to make a living.
@@Mrhellslayerz @Fr3k3 Look I don't know your guy's whole stance on this, but those are not a fair comparisons, something more comparable would be the automation of factories which effectively decreases the manpower needed for the same output, and although it may create new jobs, it probably won't be enough to replace all the jobs it displaces, some people will adapt and work these new jobs, some people will move on to other fields. And that isn't a bad thing, because in the end we're just increasing our productivity and quality of life, less time from our limited time alive needs to be spent on tasks that we can delegate to machines. For me that's a good thing! Now, what we'll do if eventually there's not enough jobs to go around, that's another discussion entirely, but as for the artists, they'll need to adapt and integrate the technology into their workflow to increase their output and remain competitive, because for fortunate and unfortunate reasons, this technology isn't going to stop existing. I for one, as a game developer who does art, am thrilled that I will get to take the ideas in my head and put them into the real world faster than ever before.
@@GabrielKoba The difference is that factory workers didn't dedicate decades of their life to learn how to work in the factory, it's like an hour of instructions how to do your step if even that. What's an artist who spent 30-40 years mastering their craft going to do when they're replaced by AI? And with everything getting replaced, where's everyone's going to go? There's not going to be enough jobs for everyone, so are people just gonna have to starve and die?
@@leetri That's true, but that's the closest comparison I could come up with. As I said, that's whole other discussion, but I do believe sometime in the future some kind of welfare system will have to be implemented to couteract these effects, how and when I'll leave to brighter minds than mine to figure out. What I really don't want is for the solution to this problem to be prohibition or extreme regulation of automation and AI, as in the end these technologies can be extremely beneficial to us, IF we can adapt accordingly, and to do that we can't face these issues with fearmongering. Remember that money is just a thing we made up, and we made it up to figure out who gets to have what, so if there are no more jobs there won't be any people with money to buy anything anymore so we'll have to figure out another way to decide who gets to have what, or simply give money away even to people who don't work, like a UBI, though I don't know how feasible that would be.
I love how you are using the open source spirit to open source a workflow as well. This really has a lot of potential to become something truly democratizing to animation. I know you see it as an anime tool but I immediately though - this is basically the basis to how everybody might be able to create "A Scanner Darkly" on a super low budget with a tiny crew in the very near future and help improve the tools and the process. I love it!
Is it open source though? From what I can see everything is locked behind a paywall on their website
Democratising animatio- stfu how about we "democratise" your home, your bank account, your memories, your life story, you're using that word as some kind of justification
"Did we just change animation forever?" The answer is no. No, you didn't. Rotoscoped animation has been around for the past century. It's nothing new.
Real
No, you changed the art direction of live action forever. The art of animation is as much about creating unique movement that can't be done in real life than it is about how it looks, and you can't recreate that by filming live action and putting a filter over it.
It's really like assisted rotoscoping, it'd be fine for a sequel to 'a scanner darkly' but it's far from an animation replacement, and insulting to think it's a replacement for the actual craft.
I think this is a good point. The process of live filming and conversion to an animated style is not equivalent to animation because the movement of the characters is restricted to what the real human actors can do. Animation, meanwhile, can do literally anything, unbound by the physical capabilities of real people. It's stylized live-action, not animation.
Thanks to this guys comment, I've now learned that everything I've ever seen in live action movies is 100% based in reality. I can't believe Henry Cavil can fly and shoot lazers out of his eyes. I always thought that was special effects and green screening. Who knew? Also, your comment is dumb.
Couldn't they relatively easily take the model they've made and apply it to some 3D skeletal animation to achieve anime movements? Just like they're physically acting things out they could take their body scans and animate them.
@@sirdinkus6537 wow someone who misses the point of the comment and the general fear of the devaluation of the vfx industry that's been going on for years
I think John Muir said something like "It's not blind opposition to progress, it's opposition to blind progress" You're not nearly as excited about this as studio execs and producers with their finger on the "lay off" trigger
Exactly this
It’s not that people fear the possibility of bad things It’s that people fear opportunists using those possibilities
Do you light your home with candles and get to work on a horse? If not, how DARE you put all those chandlers and ferriers out of business. You're an actual monster, jesus. /s
whatever, I'm not into hamstring progress to artificially create jobs
@@kjohn5224 Define progress. This seems like a total regression of the art form, yet passable enough to get an audience.
As a student in technology with a lifelong passion for art and animation, I understand both sides of the debate on this method. On one hand, it’s fascinating and opens up the door for new styles of animation and streamlining the tedious parts of it. On the other hand, all this video shows is that it’s still a TOOL that needs improving, and that can’t truly replace animators. It still requires their work as a reference to draw from, and then to go back in and touch up on the frames. For more elaborate animation sequences or set pieces, they’re still required. My only hope is, if it is implemented going forward, that it doesn’t then lead them to getting more underpaid/undervalued than they already are…
@CorridorCrew there is a background remover ai that should allow you to get rid of the green screen if you could create a consistent clothing ai then you could pick clothing let ai redress you regardless of the clothing you are wearing as well. Then if you can create a background with an AI say for instance a scene or a moving scene from video and then turn that into your anime style this would allow you to discard even more prep work or possibly all of it to move the production solely to acting and ai processing. With extravagant clothing and scenery. It is possible that all of this already exists.
Part of what gave Ren and Stimpy its signature psychological style was that the pilot was given to 3 different studios to draw. Despite having the same animation guide, 3 different interpretations were made, so from scene to scene the style changes, showing the inconsistency in Ren's brain.
i think i read that they never wanted the same style shown, always a different one ... i loved that show growing up and drew ren and stimpy all the time... i miss that classic show
ok
@@camquoc5718 Yep
@@camquoc5718 mkay
no wonder it sucked so much
I'm an artist studying animation and illustration. This is awesomely terrifying; I love it and at the same time it makes me feel scared. Not sure what the future will be like but god, media is changing forever.
This could actually save animation studios in the western world. I used to be an animator. animators haven't seen much of a raise in 20 years. They are the lowest paid department in all of film, which is why i moved into regular film work. They are paid a flat weekly rate, no mater how much over time they do, and it just isn't fair. everyone else in film gets paid tons of over time. There is NO JUSTIFICATION for why animators and CGI artists are being paid so low, especially when they require the most education. Then the pandemic came along and things only got SO MUCH worse, because now it has opened the doors to the possibility of hiring people who work from home, and now studios can hire animators from India and Indonesia who are willing to work for far less, driving down the incomes of artists in the west. THIS might be the solution that fixes all that. This could see animation studios return to the west. They don't need long hours, or large staffs and can finally work under the constraints given to them without outsourcing to asian studios. This might actually be a GOOD THING.
There will always be a place for traditional art. As the style set will need to be created and further tweaked for production
@@squip7 yeah, all the jank could have been quickly touched up. Way faster than drawing frames from scratch
@@FablestoneSeriesyou think studios will use this as a reason to improve hours and rates? Bullshit. They will use this to pump out more content for less money. Executives will see huge profit but the situation for animators will not improve, if not worsen as their skills will no longer make them valable
The heart of the problems with this is the state of labor selling as an artist is extremely poor. LABOR SELLING ITSELF IS IN DISARRAY. There isnt any future for this tech that doesn’t displace entire classes of workers and to say thats for the greater good only condones the system of exploitation.
The answer to automation is a guaranteed minimum life standard, not defining empathy by making everyone else give up greater opportunities of any technology, entertainment-focused or otherwise, because it personally affects your livelihood. Especially when some of the artist community mock and insult anyone who enjoys the fruits of said technology, all while pretending to be arbiters of empathy, value, "soul" and whatnot. As someone who couldn't find what I enjoyed but knew what aesthetics I cared for, I have taken much more to generating imagery I care for than to constantly browse in futility. It is enough of a statement of value that I'm willing to do that, no matter what I get for it outside of said images. No pretentious pricks who want to shove their idea of value down my throat will ever change this. If your argument becomes that nobody should be doing this without suffering as you have, training, rather than ensuring that nobody should have to suffer as you did, then empathy is not the priority for you, outside of what you see of yourself in others.
I painted my first Pikachu last week and this video worries me about my future as a potential animator. Actual animators: This is a cool tool for animators, not a replacement.
on godddd
im not sure how an animator would use this. personally i think it would be cool if there was an ai coloring tool for animation. coloring and shading animations takes way too long.
@@alexanderlumsden7010 that's up next, I saw a few videos on that
There's some pretty big animators replying to this and they all hate it. Hell as someone who has done animations for money especially small simple ones this completely kills that. It looks ugly and soulless, but it's cheap so it's sure to get adopted
@@Norrsky Then again problems like the one you mentioned had existed from the beginning of modern society. Home-made hand-drawn vs factory-made computer generated, etc. There will always be advantages to both takes. AI is good but needs something that was already created to train it.
This just makes me appreciate Joel Haver's animated skits more
Aren't they AI generated as well?
@@avokka no, he hand edit every frame and adds the colors
He uses rotoscoping, which isn't really AI in the same sense, but does use computers to calculate the frames. He still has to hand draw the characters and such.
@@nintendomario007 that’s what I mean
@@nintendomario007 but isnt CC's method just rotoscoping as well? Their style in the anime video is nothing like the anime they trained the SD Algorithm with. Also I love his style, checked out to remember, he uses Ebsynth. Sorry for my mistake
my opinion as a professional animator working for anime in the past 4 years: no you have not changed animation. You only created a filter that you feed with art of someone else. Not even the character designs are drawn by hand, you only added your own pictures to generate these models. this has nothing to do with animation, neither it has to do with anime. Anime has and always will be associated with handdrawn craft. The creative freedom comes from direction, proper scriptwriting and the collaberation of animators, background artists, musicians, voice actors, the production managers who coordinate these things, etc. There are so many people involved in a single production to create an episode. this production feels soulless and absolutely has no value, no plot, no heart. It's just a terrible copy of something that already exists in a way. No credit was given to the people you took the 'artstyle' from. Only because it was free to watch online, it is not free to steal. This is basically just next level tracing/rotoscoping. Even in cgi anime, boards, characterdesigns are handdrawn. The models are rigged and animated by hand in most cases aswell. The foundation for some of the Keyanimation of the Cgi was crafted through handdrawn roughs to plan and figure out motion. AI is not capable of utilising the 12 principles of animation. it can not use squash and stretch, timing, figure out proper spacing, line control, staging etc. There is no stylistic and original choices for the artstyle and motion in your approach, it's only your human video reference. I only see this as a try to profit from something that has no ethic value. you have absolutely no respect and idea for the craft. it's just insulting to think you changed animation in a positive way, while all you do is trying to devalue handdrawn 2D animation as a whole.
What's your opinion about hologram art
Yo, what a surprise to see you here Chris! I'm a big fan of your work and everything you said here was on point. Regardless of what happens, I'll always have respect for the dedication and hard work animators have for their craft!
Tell em Chris!! Side note: for anyone who's wondering who Chris(Yenyen) is, he is an animator that has work on chainsaw man, One piece, Fate Grand Order and etc, btw almost all of his scene is difficult action scene so yeah..he know what he talking about
Thank you sir, well said. Also, amazing work!! You are an inspiration!
First, you obviously don't know much at all about how AI derives its output. It's not a filter. It's not rotoscoping. Absolutely nothing similar to either of those. Second, I can smell your copium from here. Your industry will be adopting this tech within the next five years, if not sooner. It will 1000% displace a majority of traditional animators as the tech reaches maturity. You're boned, just like the coders.
I used to love making animation, hated that it took so long to do, so I quit to do video editing, production, and marketing. Now, this technology makes me want to utilize AI and get back into it. Crazy how things come back around.
So now we're devaluating the work people took "so long to do" and, because it now "fits our schedule", it's the second best thing to whatever you went on to do? What about those who chose animation wholeheartedly, taking all those risks and making all that effort you never wanted to make? What an empath! Furthermore, as others stated far better, this won't change anything the way you seem to think it will. Not saying you shouldn't go have a try at it, but that's not what passionate folks seem to think about all this and you might want to look into that beforehand.
@Ioana Tbh yes I am. 🤣🤣🤣
@@ssj_roger skill issue
@@joanabug4479 why are u so angry, like you said it doesnt change anything its just a new tool
@@ssj_roger Skill issue is right. You don't have it. 'Waaa- it takes so long and I'm terrible at it any way so now I'll just steal."
Please do an update on this! Looking forward to learn how it progressed :)
It progressed into a tool called Sora
@@chrisrogers1092but Sora is openAI pet :(
Awesome job, I've been testing with some things I created for while, things are getting very interesting right now!
Hi l am big fan
YOOOOOO!! Can't wait for it to drop
If you're not an animator - why don't you just work in a different aesthetic? Why not leave drawn art to people who draw - and you do art that isn't drawn, if you can't?
booooooooora meu jovem. bate com o piru na mesa do jeitinho que já tem feito, tu é o brabo!
@@ithurtsbecauseitstrue1922 You realise this can greatly aid animators as well right. Tools like this enable people who are solo artists to accomplish way more detail than what is otherwise humanely possible for them. It unlocks artists who are otherwise severely bound by economical differences.
This seems really good for static, or easy to produce camera shots. But animation still has a leg up for complex sequences and crazy camera perspectives that you'd commonly see in fights/climactic events.
It's a matter of time though
Remember how mediocre AI art generation was when it first came out...6 months ago? Yeah, if it's gotten this much better in like half a year, how long do you think the "jank" is gonna be around? A year or two more?
@@sirdinkus6537 Even if they get past that, there's only so many styles to go off of. How long until it all gets old and they run out of styles to use? And how long until laws regarding animation are put in place where AI art that is made to resemble a specific style without permission becomes illegal and artists will be able to file a lawsuit over? Just as it's a matter of time before Artists are put out of business, it's just a matter of time before we'll need them again, because as obsolete as they are becoming, it's a lot less hassle to just go for a real animator. Plus they'll probably be in higher demand like animators were a little while after CGI was introduced and started taking over.
@@Karma-ji6ud they chose this style, but as they said in the video there were so many other types of styles to base their ai to work around. that’s just as limitless and subject to boredom as hand animated cartoons. i don’t see this as a way to entirely replace hand drawn work, but to complement as style evolves with it. whether you like it or not i don’t see this ever leaving the industry now that it has entered
@@sirdinkus6537 I think the jank will be for a while now. I draw but I also use AI a lot, I can say that the growth of the tech is not necessarily exponential, it has already hit a pretty hard ceiling and only minor improvements are being made at this point. But yes in a few years it will probably be able to do a lot more and with far more complexity. Will take a while though, don't expect it to be as fast as those last 6 months were.
Regarding the AI animation, I could see this tech being used for a pitch or maybe 70% of a film that looks in a rotoscoped style (character only moments and such). I think set-pieces would still need to be built by an animator because those moments require more care. I could also see this tech being used between key frames.
Adventure Awaits HUZZAH
You can still use this work process with 2d animation as base rather than irl footage. So an animator would be about to sketch or outline the relevant panels and still have the AI do the heavy lifting on the tedious parts.
It relies on input so none of this technology exists without someone having created in the first place. It’s like someone cutting their own arm off because they feel the hand has evolved beyond the arm and body but will always rely on the foundation no matter how resentful the hand might get. You don’t want to end the addition people might add to the style catalogue of the ai because that just makes everything better. This could add more jobs for animators if they were hired for a job and did a bunch of single frames to create a style catalogue for the ai and boom the people good at filming can film the shot they want and animators get it done in the style they created.
I like that this still required good filmmaking techniques. You guys did an incredible job seriously combining these tools to execute very interesting mimicry of anime.
o
@@andrewreynolds912 That's right, but in theory, a small animation studio can create a data set in a consistent style and feed the AI with them to learn. Now instead of ~60k drawings for a feature movie drawn on twos, they just do a thousand drawings, which significantly decreases costs. And at the end of the day, they can theoretize that they used only their own assets, creating what is a glorified video filter they can apply to live footage. It's not exactly animation, it's not exactly live filmmaking, it's just something new. Can be exciting when used correctly, probably will be abused and miusesd 100:1 :D
@@andrewreynolds912 no
@@KennethJAdams That sounds awful. I would never want to watch a half baked film like that. I want hand crafted animation from passionate artists, not the median of their skills.
@@KennethJAdams the whole point is that it is drawn by people, if it isn’t then it is just soulless.
This is 100% the type of thing I would have tried to do in film school. I absolutely love genre-bending multimedia filmmaking techniques, like Cloverfield's found-footage meets big budget sci-fi horror, or basically everything Linklater's been doing for like 25 years. Bravo, guys.
This is not animation it’s rotoscoping. It does not capitalise on what frame animation is capable of. Animation is there to break the rules and expand on what’s possible in reality.
First when rotoscoping was invented people complained it was not real animation and sullied the art. I disagreed, how ever using a computer and algorithms to produce rotoscoping is.
I guess AI is inevitable... Hope it will be used as an artists "tool" rather than a "replacement" for the artists
I hope so too.
Depends really. When mechanical looms became widespread, weaving as a profession pretty much died out within a few generations. There are a few small brick and mortar stores that have been around for hundreds of years that still do it, but the vast majority of cloth for things like clothing, bags, backpacks, tents, ect are now all manufactured by large factory machines. I sadly suspect it will become something similar for AI art. There will always be a market for hand drawn and hand made goods, but it'll probably become more niche as time goes by. Meanwhile graphic design, especially those for and by large companies, is almost assuredly going to move to all AI sooner or later
Maybe the hope is that imaginative animators can produce their visions quicker and without the constraints of budget or studio interference.
HAHAHAHA! It is amazing how fellow artists have no imaginations. Can you not project 5 years into the future? I invite artists to get off the internet and sit by themselves. Conjecture and imagine how corporations, consumers, and creators fit into this puzzle. This technology WILL replace artists.
@@sparklingwiz2459 it won't replace artist, it will enhance artists... Just like the camera didn't replace artists at the time of its creation in 1800s... Or how not everyone became a visual designer just because Photoshop was released to the public... Or how having a high quality camera on your pocket doesn't make you a professional photographer... Technology's not on the level to replace humans, yet. As you see in this video, they had to do countless tests to make it work right, and still it didn't work perfectly, so they had to work over it to create a expected result... It's not like you could get this same result just with 1 click, you still need experience, you still need the knowledge to make it look how you want...
The reason we record dialogue first. Is so the animators can draw lip sync to the sounds. And helps with timing our shots. I guess now you can time your motion and action to the dialogue tracks. Sometimes the audio can inspire certain actions
In Japan they actually do it the other way round though. Animate first, dub later. Recording first is a western thing.
@@lujho yeah. A quick way to work to a tighter tv schedule. Though there are definately major benefits to recording your actors first
@@mikeglasswell-gameplay I'm pretty sure as I played Destroy All Humans 2 - Reproded, I noticed the first time in years a lip synced audio for German, I think that must have been the first time ever I saw that. I'm almost certain Unreal Engine either has a tool for that or there is a middleware that now syncs lip movements to the lines spoken, it was too perfect and I'm almost sure they didn't do facial performance capture for every other language!....
@@Quast there are some lip sync generators in animation software we have used a couple. For 3d software it's easier as the mouth shape can be easier to manipulate. 2d Hand drawn mouth shapes are different. And you have to listen to the audio and draw the right shape for the sound. In Anime they like to save time and cash, so they will usually dub after the animation is done. The animator would animator just some open and closed mouth shapes. Hard consonants or hard vowels.
@@mikeglasswell-gameplay I'd certainly prefer if the audio still gets recorded in a studio and not during a performance capture, I really don't need the 100% respiratory rhythm of an exhausted human during a full body performance capture - that's where I wanted to go with this. :p
Here is an idea for flickering and inconsistency: What about use the previous frame as a reference for the next frame for stable diffusion? AS long as it is not a scene change, it should be similar.
Honestly, it's very similar to how rotoscope animation was done but instead of actual people it's AI.
or just get an animation team to do it
Yes, too many people are focused on aspects that may not even get to the point of replacing an animator. Who will train the AI if not the artist, it still needs reference to go off of. It's not like people wouldn't get tired of seeing multiple works in a particular style. Even then, plenty studios and freelancers animations take reference from other works for their style and that can be viewed in the same light. Proper artists will have to develop yhe neww art styles and concepts for the AI to replicate, probably still needing hundreds and thousands of frames for reference, definitely not something that will be putting anyone out of business soon. If anything we might see a boom in concept artists.
As someone who's still learning art and dreams of learning animation, this video is scary. Cool, absolutely but also terrifying.
so wiill you just change your carrer asking because iam larning art too
I mean ... That's life, innovation will always happen and further what we do and how we go about doing it. Art isn't the first profession to which this happened to nor will it be the last.
Don’t be scared of it. Learn to use it. Their will always be animators but their responsibilities will be different depending the available technology. Hand drawn artist were afraid of computers replacing them. The only artist replaced were ones who didn’t know how to use the new tools (computer)
Hand drawn animation is the purest incarnate of the discipline. It will make you leagues more skilled and useful than people who pass it up to fumble with 3d models or whatever the workflow/learning process will be with this AI nonsense solely. It will never not be impressive to see someone sit with a pencil and sketchpad and limn something out accurately.
It should feel empowering. Right now they're using this tech to emulate old anime and make cool things from it. Think of learning animation. Now think that instead of needing to join some big studio and work on some director's projects for DECADES before you have the skills and clout to direct your own series (at which point you'll hardly be doing any of the actual animation, at beast some storyboarding and keyframing and approving concept art) you can instead be your own studio. Use the AI to help you develop a cast of characters, train it on your characters, your settings, and your environments. Turn that tool into an entire animation studio at your fingertips. Now you don't need to work for a studio. You can just make what you want. Now of course, will get you get paid? That's on you and whether others want to pay for what you make. So if you want a JOB, then you'll need to anticipate getting a job training the tools for some big studio.
18:15 The candles should be moving through the shot in the other direction, if you want it to look like the camera is orbiting around Nico's character. The background is moving right to left, which means that the foreground should be moving left to right, in the opposite direction. The way it is, it makes it look like the camera is dollying to the right, with Nico's character flying along with the camera through the room.
I was looking for this comment, it bugged me alot
thats what happens when people let AI do the job instead and dont understand what theyre doing
@@armandoalvarado3956 or, or... Maybe it's a mistake that slipped through before they finished the final product
@@armandoalvarado3956 It was composited in, not made by AI. That was a human mistake.
Glad someone else noticed this too! Incredible video regardless!
the work is amazing! but I'm thinking of one thing, what's the point if the rendering is the same as a well-made classic anime? filming, time, money, personnel, 3D animation... Basically I said to myself "great" the manga/anime universe is now really adaptable to the screen but if the rendering is almost identical I don't see how it becomes useful as much to make a classic animated film or I did not understand something?
Great work, I want to learn animation from your work. Keep sharing tutorials, Thanks
I like this conceptually, but I hate what it will most likely inevitably mean for proper animators. I'm worried traditional animation will become an indie only thing kind of like certain game genres. Unfortunately, Pandora's Box has been opened and there's no putting the lid back on this one.
I just hope AI art will die out like a trend It's so annoying that they keep screaming their new stealing tools and these kids who have 0 skill rooting for these ppl
@@grandmastalin7796 It won't. As technology progresses, Lots of jobs are going extinct and HAVE gone extinct. Although it is hard to process seeing the extinction of many people's livelihoods, There also aren't any ways to prevent it. So long as Human society develops, Progressions in technology such as AI is inevitable.
the idea that they just "ripped off" vampire hunter d's style just leaves a bad taste in my mouth not sure if im alone in this. I dont have any issues with the unreal church backdrop that was paid for. I wish they would have paid an artist to create a style for the training data. (even if it is inspired by VHD the person would still do a self rendition.) im pretty sure they didnt get any permission by the creators of VHD to use that dataset. i am afraid that it will legitimize this way of working as it is already a big issue. as artists themselves they should be a bit more aware of this.
@@grandmastalin7796 this is such a dumb take
I think this will be an excellent tool for already established artists to use.
As soon as I began to gain confidence in my drawing ability this comes out
Don't waste your time thinking about it.
Well I feel that but what they did was just A. I rotoscope animation where you trace over film a popular technique Disney used and invented, most of the stuff that makes it look good are techniques developed by anime artists. If A. I becomes an industry tool there will be copyright put in place so only certain works can be used by certain people at least that's what we all hope for but the thing is if everyone stopped making art these A. I imitations have nothing to pull from and now one to prevent stuff from becoming boring or static, so don't give up because things look impossible see through the illusion of things abd persevere we need to make A. I our tool not our replacement.
@@HypArtz002 well said mate 🤝
Can I offer you some encouragement? Be yourself, no substitutions, every line, stroke, whatever medium you wanna work in. Bring yourself into everything you make. Love doing it. This video wasn't made with care, it was obscenely executed with stock anime effects thrown on top. The background is blocky and aimless. Comparing yourself to something like this is self-sabatoge. This is a tech demo.
@@NicoleHam gave me a smile, thanks!
Personally i find that AIs focus on just making an image accurately rather than consistently with the other image it generates makes it pretty awful for animation specifically. I mean there is absolutely no sense of motion, things move but there is no 'force' behind it. The AI also includes a lot of details that are completely unnecessary and quite distracting, because the AI cannot look from a persons perspective and tell what information is useful and what is not. It uses hundreds of artists as references, and the problem is that many different artists will use different levels of detail depending on their style. I am saying this as both a computer science student and a traditional artist. I sincerely hope that this isn't used to replace actual artists for economical reasons by large companies, when it clearly isn't finished and the way automation has already been used in other fields. Automation works especially well for what needs to be mass produced, but it isn't great in the decision making, as you don't get that much control over it other than changing the prompt and altering a few variables.
To me, and with the right pipelines for automation, this could represent the simplest and best way to storyboard animations possible. Imagine having a fully animated double to work off for reference.
I am a trained animator that works in the industry. I am also dealing with a hand injury that makes drawing for long periods of time difficult. For this reason, I can understand both sides of the argument for/against AI animation. As an artist, the idea of being replaced by a program and losing my job is terrifying; as someone who can't draw an entire video by themself anymore, the idea of a program doing the tedious part for me is alluring. But taking someone else's art style and calling it my own is a bridge I won't cross. I think the phrase that bugs me most in this video is "democratization". AI animation programs of the nature in this video are essentially motion capture filters - all the data comes from the actors and the data preset, none of the character motion/emotion is done by an artist. That's perfectly fine, Joel's videos are a great example of how that can be used creatively, but calling it "animation" is a bit disingenuous. This is combining motion capture data with a program simulating an art style *you* didn't make, and costumes/backgrounds *you* didn't design. AI isn't removing barriers, it's removing the need to have other people involved, for better or for worse.(Also, the idea that anime can't have details like costume buttons or rim lighting is preposterous, even in the cel days there were tons of anime with details and special lighting!) Something this video is missing is *timing*. In animation, 99% of the time you create a few basic key drawings of the major poses of a shot, then fill in the drawings in-between (thus the job of an in-betweener.) With this video, it's more like straight-ahead animation where every frame is a new pose with no true connection to the frames afterward. There's an art to using motion arcs/x-sheets to communicate how long an arm should hang in the air or choose which mouth shapes to use when. If this had been made by rendering a few keyframes in the AI, then using a person or a different program to interpolate the shots inbetween, it would be much more like actual animation (and reduce the need for a flicker filter.) AI at this stage will likely take the low-hanging fruit jobs of the animation industry: corporate commercials, SnapChat filters, a local car ad, etc. But the true art of the industry is not yet present in models like these. There is more to animation than just recoloring live-action footage. If you guys had made your own anime dataset, designed your own costumes and backgrounds, and called this a filter rather than an anime, I would've praised this video up and down. As it is, I see this like a paperweight from the dollar store next to an actual carved statue - it suits the needs of the masses and makes art more affordable, but you lose both the intricate details of the original art and the artisans who designed the art to begin with.
Actually i just realized. Wouldn't this have the same limitations of real life? One thing I love about watching animation is that you can see movements that would be insanely hard to do in real life. Like you can't retrospect Luffy from one piece. All this can do is turn a person into a cartoon, but it can't make a cartoon. Still, I'm sure there are uses for this tech, but it would now have physical limitations. There's just many cases where physical limitations is just not going to be worth it. Edit: I mean exaggerated expressions, and actions is just a staple.
This is the best comment I have read so far and it also helps understand the things that can be improved so that we can integrate some of these techniques in full blown animations like mappa integrating cg into their actual 2d animation...artstyles that lean towards realistic proportions and face shapes can really benefit from this as it will take less man power and work now to do so
@@lightningpenguin8937 I wish I could articulate so well!!
The rest of the animations were still done by humans though, like the effects for everything else and CGI camerawork etc. The only animation that the AI did was add the filter to the actors.
@@lightningpenguin8937Then you should also realize the fact that technologies can be IMPROVED and NEW technologies can be INCORPORATED into existing technologies. Hands are hard to be drawn correctly by AI? ControlNet has already fixed it. Can't get exactly the pose and composition you want? Openpose and Multicontrolnet has already fixed it. Exaggerated facial expressions and physical limitations are going to be just the same. They WILL be fixed in less than 6 months. Edit: Spelling
The problem of turning live action cosplayers into cartoons is gravity. And human acting is usually less expressive than what professional animators achieve. For super Saiyan over the top expressions that will not be evident, but when it is time to drama and showing emotions, the differences are noticeable. AI allows very generic improvements. AI may defeat amateur mediocre works, but it is not yet ready to match the work of pros. You can tell when you watch Arcane. 80% of the messages conveyed in Arcane are in the face expressions and body language that allows a message without words.
They call the facial animation in Arcane "micro expressions". That shit was all done by hand. BY HAND MAN. I could hardly believe it; it took the studio YEARS. And I agree with you, the level of detail in the animation turned the cartoon characters into actors. That "life" was breathed into them by the skilled artists behind the animation. I don't think the mimicry of AI tools is going to replace that.
AI produces generic imperfect solutions. AI always is better than amateurs in every field, but it cannot replace pros in their field. AI can be a great aid as a content remixers to generate remixed ideas, but AI cannot create or improvise. If you teach AI to draw squares, it will only be able to draw squares. If you teach Van Gogh, it will be able to remix Van Gogh squares, which may look original for the casual eye, but it is a remix. For decision makers, AI is a tool to produce bar charts. If you would not use a bar chart to solve a problem, do not use AI. The great problem for AI decision making is that AI may underperform with corner cases. The non Van Gogh non square case. Corner cases add false positives and false negatives, and for decision making that is terrible, and real world is full of corner cases. So if you were told AI could replace people, I would say using AI could make decision makers be fired. I have found terrible glitches with AI. chatGPT for example. It told me about a Battletech battle that did not exist in the described year, in a castle with the name of a planet, located in a planet that is placed elsewhere. Terrible lore inaccirate error. It also cited sources with chapters that did not exist inside these sourcebooks. And I have known about a farmer who asked questions and got wrong data. if you asked AI to code in Visual Basic, it confused image and picture controls, creating inconsistent incompatible code that would not run. So AI can write s simple piece of code correctly, but it is still like that drunk friend who sometimes say things that make sense, but some other times, he has cantina existential chatter, finding pink elephants where there are none.. For art, AI has not learned the rules of art, so eyes may point in the wrong direction, for example. It has not learned to overcome the uncanny valley problem. That is a problem that is difficult, even for experienced artists. Using AI to convert people into cartoons brings a physics problem. Action sequences and character faces would be restricted by the talent of the actor and the contraptions used on an actor.
Agreed.
Imagine a small studio only having to hand-animate the over-the-top parts, rather than the whole thing. It's the mixing of the mediums where I think you'll find the true art -- no longer tied down by major corporations and millions of dollars of funding, but not tied to computer-generated ai-art either.
I think AI can lay the groundworks but for the details it would still require manual intervention and improvement. It would still lighten the workload by a fuckton
I just started learning animation, I don't do more than draw a practice sketch and run an animation every day for no more than 30-45 minutes. I think for the one thing I want to make in my life, this might make that personal project possible.
AI art is very much a moral grey area for normal single-piece digital art. But for animation? It could definitely save a lot of time and money.
And ruin it completely, if you can make it in an instant with no effort, then what's the point? Nevermind it's a twisted amalgamation of the work of all who came before you, it isn't adding or building on anything, it's spitting in its face, you're not using it to create your idea, you're feeding it to this amalgamation
You could probably remove the flicker further if you put correlative dots on the actors' faces for the AI to recognize complex facial movements, like the Hollywood studios use.
Someone should reanimated this and do a comparison between the two
Great idea. Might take time though..
that would take an ungodly amount of time even with a team backing the project.
@@milano7250 atleast the audio and reference pictures are there already
In the time it would take for a team to animate this, A.I. would have evolved to a point where it would be better than the animation done by the team. Seriously, A.I. art has been only been out for the public? 4-6 months? & we have already gotten to a point where we are already making A.I. animated videos in less than half the time of the actual teams creating videos without A.I. with less than half the crew.
@@ghostagent3552 if real animators tried itdd take over a year.
First off, this video is very well made. There was a lot of artistic talent put into the production that cannot go understated. You set out to make something that was reminiscent of a “90’s anime style”, which they did. To call this animation however is disingenuous. You used an algorithm to rotoscope their video for them, after scalping art from Vampire D Hunter. You also did not credit the director Yoshiaki Kawajiri, the art director Yuji Ikehata or any other artists from VDH in the video. Second, saying the phrase “democratizing art” is like saying we’re “democratizing speaking” or “democratizing writing.” Anyone can create art; it isn’t some talent you’re born with that “non-artists” don’t have. Just like anything else, it’s a skill you need to build. This video is proof that the phrase is nonsensical, it took thousands of hours of collective skill to operate the software you used to make it! You are not “democratizing art”. At worst you’re only making it easier for cheapskate companies to try and make quick, unethical, and cheap content. Studios have already been laying workers off, overworking and underpaying their animators, and all the while making worse productions because of it. With how much reverence you gave the animation medium overall I’m annoyed at your choice of words and misplaced positivity in the phrase, “Did we just change Animation forever?” At best this is a useful tool for achieving a unique stylized film. If you created your own assets and references, instead of ripping off existing work, I can see the use of this as valid. Again, fantastic work, I enjoy your guys’ videos but please don’t claim this is some sort of boon to artists or that it’s the next step in animation or that it’s going to make creating anything you want easier. That kind of talk only adds to the idea that animation is a lesser form of art and film.
Corridor: Did We Just Change Animation Forever? AI haters: I'm gonna bury this channel
They can try😆
Here’s they way I see it: this is just mocap. It’s already used for movies, video games… why not tv shows? This is just mocap with an anime art style.
Anime’s first appeal for me has always been the impossible camera angles. Like in the Animatrix when the camera follows the bullet through the headshot hole and out the back. It may take longer to implement since this style will be using a real camera, in time this style will probably mesh with cgi for these more difficult shots though.
It'll be pretty easy to create that bullet thorough head shot though
@@asar2252 do it then
actually if this was actually animated then it wouldnt be that hard but this isnt animated
Nice point
@@sassythesasquatch1794 The background is an asset from the Unreal Store that was given a pass by their AI. You could quite easily do a CG bullet hole, then do a pass with the anime filter. Could also have an animator animate it and place it into the shot.
I'll admit with the amount of jank that was still in the Spiderman short, I didn't think you could take it to this level so quickly. Amazing work!
The beginning is a little misleading. Animation studios have used video footage reference for decades and still do. Ethan Becker is someone who encourages people shoot their own reference footage and even draw over it (not rotoscoped but stylized like anime).
Maybe from a post production vfx pipeline it will change peoples entry point to AI animations conceptually preserving traditional pipelines. I think the text description and labeling can get more localized to each film to prevent green-screening and target isolation with masking etc. Good composition and edit.
5 years from now things are going to be so different, it's wild how things are changing fast
Just think about how 3d animation went from a novelty to everyday thing in 20 years.
@@andrewreynolds912 A lot of people are all for it tho. Now, which one will win?
@@andrewreynolds912 just like artists use other artists works to make their own art which is in turn used by even more artists to make their art and it goes on and on and on
@@shinigamisenpai3303 Wonder which one makes more money? AI? Well then that side will win.
A lot of this shit will be straight up illegal in 5 years. Japan is not going to allow their largest cultural export industry to be fucked up by morons with AI licenses. This will be made a serious crime in japan long, long before they allow a single domestic anime to be made with it.
My university Final Year Film Project in 2009 was a 15-minute short film with a visual style derived from the rotoscoped look of A Scanner Darkly. I shot it live over 4-days and spent the next 4 months in the editing suite converting every single frame in Photoshop before exporting into Premiere 2.0 5-6 days a week, for 15+ hours a day. It's amazing to see how far we've come in producing the very same look using technology
I was just thinking about Scanner Darkly and the work that went into it. I suspect ten years from now Anime/Pixar movies will be filmed just like Avatar. I think we are seeing a change in motion picture technology with AI similar to the CGI boom in the 1990s. Video Games as well. I predict Animation will all be AI rotoscoped motion capture.
would you mind posting it on your youtube channel?
Can you post in on KZhead
It's funny how all the bird people are complaining about the AI conversion tech, but seem to have completely forgotten about automated rotoscoping. I could only imagine what kind of films Ralph Bakshi could have made back in his prime with today's technology.
@@ZarconVideo pixar as a company is incredibly against motion capture, especially as live action acting doesn't have the same principals as animation
Take the image, remove the croma, make it b&w, increese saturation at max, put it an outline, now grab the real image again, remove the croma again, mutliply the result with our previous outlined binary inage, and finally select all the brigth areas to promediate theire color. I think, that should make an even more clean anime style
We’ve always had ‘true creative freedom’, because one of the greatest things about the visual arts, including animation, is that pretty much anyone can give it a shot, which means it’s the complete opposite of ‘least democratised’. So tired of people claiming there’s some kind of conspiratorial gate keeping going on, when in fact the only thing keeping people out of professional level work is their skill level, which can be improved through hard work and practice - something proponents of AI image generation seem so keen to avoid. Artists become artists because they love the process to the point they’d rather draw than do pretty much anything else. It’s part of your life, your personality, your soul. Getting good is just a side effect of that passion. I hope using AI image generators does inspire some people to learn to create real art and hand drawn animation rather that skip the most satisfying part of the process, because this is just a fancy AE filter which doesn’t deserve to be mentioned in the same breath as classic Disney.
"Artists become artists because they love the process..." News flash: not everyone wanted to learn the craft, some just wanted to visualise their vision quickly with this tool and don't have time to study the craft. And that's okay.
@@mfatihbilhaq4977 not okay if if it uses the work of artists, without which it wouldn’t exist, to put them out of a job.
@@ShaneMadeArt I just find it funny when anti a.i art ppl talked about consent for their own artworks on a.i art. Because the truth is. You all already consented. When you made a social media account, like Instagram, Twitter, etc. You agreed on their TOS, that said that they're can sell your works to others third party and in this case the third party is a.i art companies that has been creating this technology since 2015. However in return you can have a platform to publish your works for free. I bet artists in the past would love to have this kinda of platform. So it in the end, it's not about using human artworks to train a.i art. It's about a fear that there's a new technology that can compete with your skill and now you realize that just drawing alone would no longer feasible to make a living in the future.
@@mfatihbilhaq4977 Brother in chirst, no arguing wit these people. They run off emotion of seeing how Ai is some sense better at producing an image, I'm not saying being an artist. They say always say some shit about how to respect the craft and bs and at the same time they say art allows them to give a creative outlet n that bs. Both statements stand at opposites when Ai comes into play, even if they made if from their own data set to create a Ai that can procure any image. Most of these schmucks would say, like seen in the above comments that this is a slap in the face of the craft or something along those lines. The ugly truth is, in some form, the Ai is better than them at visualising a idea or concept. The bar is set higher, and in the art space where there no supposed standard cuz " u can't judge art" Bull that's been peddled. Idk what else to say but you exactly put into words what's been running through my head. Thank you
@@preke953 gotta him em' with some logic.
Very small correction but actually in the Asian (japanese, korean, chinese, etc) animation industry, the voice recording is part of the post production, when the animation is finished. However in western animation, they do the voices before the animation.
That is because there are no specific mouth movement in most asian anime
@@shunbeats5431 yea they do it after and it fuckin shows lmao
@@highdefinition450 Eh not really. In dubs, sure, but more often than not, in the original language it's totally fine
If you're talkin about 6:37 all they said was a cartoon and they are Western why would you correct them about Asian animation when they didn't mention it? As westerners who are familiar in Western animation why would they be talking about Asian animation without mentioning it?
That's like correcting a western chef on Asian cooking methods when what they're making looks vaguely like an Asian dish but it's a European dish made by Europeans in Europe just because they said they like Japanese food once
I'm so glad we've automated art into a uniform sludge that is indistinguishable from the next. Now we can have more time for our 9-5 and keep the slog of creativity out of our lives! :) /s
Based
Yeah, i watched the John Oliver video about AI tech and when they showed how AI is currently used to detect subtle changes in a human's voice that is proven to be an early symptom for Parkinson's disease and dementia, i thought - yeah. That's where we should strive to apply AI to. Not this. One appliance of AI could potentially save thousands , if not millions of people, the other appliance shown here devalues ( or inevitably will lead to this ) any great art style and achievement by turning it into a readily available art "crutch" that most of the time limits the actual creativity and personal growth that happens during the process.
so far
The automation happening here is the exact same as he been happening for the past several hundred years with every other industry. Your problem isn't with AI or CC, it's with capitalism. All you're doing here is looking for a scapegoat to direct your anger at, and shitting on a bunch of computer nerds is just convenient for you.
Reddit is the other way bro
i think this should be another style of animation instead of it replacing literally every animator as a whole
How about a "How close are we to making a Star Trek Holodeck" episode? How would @corridorcrew make this happen? Perhaps a @corridorcrew vs. @corridorcrew challenge to demonstrate various perspective solutions? Even in the ep. above the handoff between teams almost feels competitive or in the 'spirit' of competition - makes the ep. really watchable on top of mind melting happy face content.
With controlnet (extension for stable diffussion) you could maybe use depth, pose and normal maps to create even more consistent frames. You could pull the depth, pose and normal data from your original footage to use during generation. Would love to see this idea experiment with further.
Technology is moving so fast.
I was going to say the same thing but my guess is when they were working on this controlnet wasn't even available yet. Especially now that you can stack multiple controlnets along with other extensions like pose editors they can really get deep in the weeds. But high-level the concepts what they have presented here showcases what is possible and it's all just accelerating at a breakneck pace.
ControlNet came out a few weeks ago and they started this project months ago. This tech is moving so fast. The next one they make will look completely different to this.
@@KeyTryer But this can be used as a foundation for that. Unlike 2 months ago where the idea was made from scratch, now they only need to improve it. It's easier to do something when you have a working guide.
I was on reddit and someone there pointed out that it was visible somewhere in the video but they never talk about it
I just cannot get over how good the shot at 5:41 is. The orange light on one side, blue light on the other, the incredible focus on the facial detail. It looks amazing, it’s great to see talented artists use AI to evolve their workflow rather than substituting it for everything
What I can't get over is when Nikko claimed they were doing the right thing by making information free to everyone... then put it behind a paywall sub on their website. Scummy as hell.
Please. What software do you use to make this cartoon effect?
I’m curious… what if you feed the final output to EBsynth but only feed a frame (or a couple of frames) with corrected eyes? Or EB synth the face and composite them back together. Or spend a bit more time hand animating the janky frames? Really it’s in the eyes. If that gets truly smooth out….
Niko: "Hey look, I figured out how to turn live action videos into anime, come watch it!" Everyone: "I'm here for Kevin's sound design"
No
As an artist who is still fighting the Ai garbage/copyright war, I respect this a lot. What a lot of Ai bros forget is that it's a tool that needs hard work, time, and skill to make good results. People worry about this axing jobs, but what I see here is another avenue and a new branch for expertise. This video needed: a style sheet created by a willing artist, costume design, an understanding of animation style and principles, video editing, storyboarding, voice acting, acting, 3d models, and a custom trained Ai with an understanding of how the Ai tool works so that you could fix its most common issues. I still think it's got a ways to go because you still have issues like weird fingers, eyes, occasional uncanny stuff, etc, and I also wish you guys trained it on art from a willing artist
"the Ai garbage/copyright war"...What's that?
I feel like it's also super important to note that the A.I. is only really modifying frames of footage they had already filmed themselves. That's a lot more genuine artistry than the way some people use AI to come up with entire compositions based on prompts.
This is good. It takes the power from the studios and gives it back to the artists. This is a good thing!
An an animation student this technology makes me so so exited its amazing love love. People that are scared of ai just see this as stealing their jobs but this is the future learn to work with it or don't as for me i still think this is super human centric creativity there is so much work that goes into this. Amazing
As cool as i think this is, and as much skill actually goes into the editing side, I can't help but feel this doesnt overcome the ethical concern from taking a style of other artists. It's not really "generative" nor "interpretive" as was said, but reproductive. The interpretation and association is kn the user side, while the algorithm just had a lot of black and blue pixels next to each other. The only way I can see that sort of thing overcoming the ethics concerns is specifically to hire an artist to create the style guide image set that the algorithm with be trained on. And to get explicit permissions/rights to own and reproduce that style guide image set. That or only use images that have already passed into the public domain. (Which is hard due to Disney kicking that can down the road for so many decades.) I'm impressed as ever. A lot of artistry went into how to overcome the limits of the tech with other software. It still feels like playing with fire
I believe that if you think that the ethical integrity of a show is based on how the viewable content was generated you are naive to the many other aspects that transpire to make content great (take this video). Now I want everyone to rewatch this video and close their eyes, just listen to it. You've done that? Great! What you just experienced was the fruits of immense effort and labor that was put in to write a script, voice act that script, mix and master sound design, compose/sample and edit music. This video isn't just an example of "A lot of artistry [going] into how to overcome the limits of the tech with other software," it was an example of a team of skilled artists coming together to create art. The use of vfx was just one step in the process and I am also considerably impressed. What we just consumed is a technological breakthrough and one of the largest leaps in humanities ability to take action on their creativity; I just hope that we can agree that gifts of inspiration can be nurtured and fueled by this software because that wonderful thing that we call creativity can be fleating at times.
@Xander Kramer now if all that effort would have been put on an AI inputed with consented artwork, there wouldn't be a problem, it would have been like the initial stages of 3d, where all innovation had to be programmed from scratch. In this case most artists complain about their illustrations being used without permission. Many may seem to not gasp this concept, but the reality is they just don't care, it was not their art. I wish more people could understand that point instead of minimizing it. But they won't because they just don't care.
@@Xxxwwwwx You're being a tad sensitive. I complemented the clear effort of this multiple times. But there is still as aspect of art theft in this process. So yes, how one makes something is actually the thing to look at when concerned with ethics. If someone draws a random person getting punched, no problem. If a person filmed punching a random person, problem. The effort of video production does not, on its own, negate any and all ethical concerns
@@dolookecki3084 all creation is imitation. That’s how progress works.
We can agree to disagree
Dean: "animation has no 3D moves" Me: Someone's never seen the opening of The Littles. Biggest animator flex I've ever seen.
They also need to watch all of James Baxter's works and see how wrong that statement is
"animation has no 3D moves" eh the fuck that even mean?
Not to mention a lot of 2D animation has been using 3D to help them create 3D moves in 2D space more easily. Quite literally using 3D in their production. Shoot, even comics make use of 3D to graybox out cities/backgrounds so they can paint over them.
It is amazing how you were able to this with quite a number of work arounds and techniques that were not built for this purpose. Imagine how easy and and impressive this would be with an AI specifically programmed to do this kind of stuff. For example an AI, that does not take single images, but the whole video and keeps track of details for consecutive frames so that there is no flicker in the first place.
Ask your local musician if they're doing it for the money. Ask them if the venue takes a cut of their merch sales. If we imagine AI making an insanely intricate jazz piece that has soul, complex chords, and still can make a reference to a famous jazz song from the 80's, or a slow modern death metal song depicting the despair and anguish of losing a loved one to an incurable illness. It's tough, but the bands we know and love in most genres in the days of music streaming, especially the smaller ones, pull through and play their shows, sleep on a bus on tour, shower once a week, and have kept going even through the invention of the Electric Guitar, Autotune, and even drum triggers, all very dividing inventions for said industry in terms of "what level of skill do you need to have to be considered a talented musician who WORKED for it". I personally see 'drawn art' whether it's on pen and paper or a prompt someone thought of, and inspired learning that follows observation (which humans do as well, but differently) It can be a scary time for artists relying on their work to be their income... But their industry is changing hands once again just like it did before. I am curious to see who will become the Rockstar(s) of art in the next generation of visual entertainment. I don't want to see artists die out, I wish for them to use AI as part of their toolkits in varying amounts and in varying weights, pre or post human input. I want to see the ever expanding definition of the traditional artists carry on too! There is so much to experiment with, and the rest may be left to fall in-between the cracks now that a new horizon is upon us. I know the artists who adapt quick will skyrocket and do very well. The art industry just got shaken up once again, and the ones who are confident enough in their skills and knowledge to keep their jobs are typically the ones who aren't panicking.
TLDR: Hayao Miyazaki appeared on a documentary and expressed his absolute displeasure at A.I. being used to create/generate animation. I will always applaud the Corridor Crew for their dedication, ingenuity, creativity and passion for their work. It's an inspiration to all aspiring film makers and vfx artists out there in the world. That being said, I am reminded of watching a NHK documentary featuring Hayao Miyazaki. When the idea of A.I. being used to generate animation was presented to him; he was "not happy" to put it mildly. He even said that using A.I. was an insult to life itself. It can be argued that you are using diffusion to create an anime look for your film as a tool. However, when the tool becomes the master that surpasses the actual artists who poured their blood, sweat and tears in to their passion; then it we truly lose the drive and imagination to create such animation. I don't want to be completely negative of your ingenuity and drive to always challenge the norm of film making and vfx. You guys always have tried to show everyone how things are possible with the will and drive. However, I do feel those words by Miyazaki are ringing truer and truer with each passing day that A.I. begins to take over things born from human ingenuity and imagination. Without those, then what the flock is the point. Thank you for anyone who has read this comment. I truly wish you and any potential animators out their a wonderful day. - Some rando guy taking time to actually type out a comment because this is an important topic to do so. (Edited for spelling and Grammer mistakes. Stay in school kids)
TL;DR: I kinda have to disagree. People said the same thing when industrialisation began. "Handmade things have a personal touch, feelings and an artistic value", while that is true to some extent. Improving the process of the creation, will always lead to cheaper products. That doesnt mean that those items will be brittle or uninspired, it just means it will be more affordable to produce and to buy. During the age of industrialisation a lot of factory workers lost their job, because such menial labor could be done by machines. Most of those factory workers were against the machines, because they lost their job and meaning in society. Not because these machines were a bad thing for everyone. I see Hayao Miyazakis answer the same way. He knows this is a threat to his career and it will be. However we shouldn't stop innovation because of traditions. Especially in the japanese animation industry, this would be a godsend tool. Animators get overworked, get pennies for their drawn animations and will decline in health as they keep working there. If you can now streamline the process of animating, by using a few drawn animations(to create the style of the animation) and some form of direction(like a video getting turned into animations). Then animators will be able to produce more high quality animations with fewer people and in less time. Don't get me wrong, a lot of people might suffer from this and i feel for them. However this will probably also produce a new job sector(i think being an AI Manager might be a thing in the future). Innovation doesn't only steal peoples jobs, it also creates new ones. (Not 1:1 more like 5 Animators : 1 AI guy) Also industrialisation didn't destroy artistic value, because someone had to design a product before any machine could produce it.
@@chinuchun I can't disagree about your point about industrialization and stream lining processes. I can also agree that it would be a boon for Japanese animators as well; given the current work ethic. Furthermore, innovation truly is a wonderful thing and can lead to new and exciting things. For me, the worrying part is when it gets to the point that one person could just press a button and an animation is created in a split second. That person wouldn't need to think about it at all. Just let the A.I. do the thinking and imagining. The person would be no longer have to "create", they would "produce". However, I will say that my comment also comes from a place of emotion as well and that I'm just one of billions of fishes in a sea of them. So, time will tell and all we can do is wait to see what the future will hold.
As a professional animator, for what it's worth, I find this really exciting... This makes me feel like so many more personal projects are within reach now, where before, the time constraints of animation as a medium made achieving all of my dream projects insurmountable. What a cool tool to have available and play around with, especially if you're training it on your own work samples
god bless, what a time
training it on your own art seems really interesting and something that can actually be called a tool. This is one take on ai art that isn’t negative I can get behind. Now their are many logistical leaps and hoping that users will be moral and won’t steal but promising none the less. Artists will always have the best takes when it comes to art. Thats just a rule.
@@Data-Expungeded I kind of see it how sampling has spread around the music industry. Unauthorized sampling still goes on, but its really tools that artists have chosen to use that have developed more recently from bottom up that's created more solutions. For example, things like splice, or producers trading and selling loop packs. Even platforms such as tracklib that provide pre-cleared samples. You're right when saying artists will have the best takes solving these problems. I can see something similar being used to smooth out unauthorized "sampling" in this field.
@@jp-is1is i have a real problem with ai in art that always says “all or nothing” instead of limited use and correction but i’m getting better
@@Data-Expungeded Honestly, same lol
Okay, SD is free but let's not forget about the fact that you need a 1000-2000€ GPU for any kind of worthwhile workflow speed.