NVIDIA'S HUGE AI Chip Breakthroughs Change Everything (Supercut)
Highlights from the latest #nvidia keynote at Computex in Taiwan, home of TSMC and is the world's capital of semiconductor manufacturing and chip fabrication. Topics include @NVIDIA's insane H100 datacenter GPUs, Grace Hopper superchips, GH200 AI supercomputer, and how these chips will power generative AI technologies like #chatgpt by #openai and reshape computing as we know it.
💰 Want my AI research and stock picks? Let me know: tickersymbolyou.com/survey/
⚠️ Get up to 17 FREE stocks with Moomoo: tickersymbolyou.com/moomoo
Simply Wall Street's Nvidia (NVDA Stock) Valuation: simplywall.st/stocks/us/semic...
Taiwan Semiconductor (TSM Stock) Valuation: simplywall.st/stocks/us/semic...
Timestamps for this Nvidia Keynote Supercut:
00:00 Nvidia H100 GPU for AI - Overview
02:36 Accelerated Computing for AI
05:28 How Nvidia Builds AI Factories
08:31 Why AI is the Next Era of Computing
10:54 Nvidia Grace Hopper AI Superchip
12:28 Nvidia GH-200 AI Supercomputer
15:34 Nvidia MGX - Next Generation Servers for AI
18:32 Networking for AI - The Devil is in the Details
21:53 IT'S OVER! GPUs Will Replace CPUs for AI
💬 Join The Conversation & Stay Up to Date 💬
Follow me on Twitter: / tickersymbolyou
Join me on Discord: / discord
Support on Patreon: / tickersymbolyou
📝 Resources & References 📝
@NVIDIA Keynote at COMPUTEX 2023: • NVIDIA Keynote at COMP...
🙏 Thanks for watching!
💰 Want my AI research and stock picks? Let me know: tickersymbolyou.com/ai
Nope.
same video why
The U.S. is a few years away from the purge. I doubt any of this is going to matter in 2030, when government debt is a quadrillion dollars, and the hatred between left and right is worse than the boiling rage level it is currently at. Then again, if you don't consume 12 hrs a day of political news like I do, you probably have no idea whatsoever what is going on in society
when a Chinese person gives a presentation in English and not in their native language - this is sad ...😮💨
@@shikaka9032 Bro just turned Nvida into a trillion dollar Organization! I understood every word he spoke. What's sad is your raciest mindset.
Bro this dude is so passionate about GPUs and tech you can just feel it. Now I see why NVIDIA is worth a trillion dollars
😂😂😂
Just see the prices of consumer GPUs. You will understand his 'passion' for getting money from his customers 🙃
Yes....i just feel it within 10-15 seconds....i want to meet him
It's just Lisa Hsu without the dress.
They still give us 8gb gaming gpu in 2023 so Nvidia sucks :P
Breakthroughs in the AI field seems to have become almost daily event.
It’s crazy how fast things are moving
@@TickerSymbolYOU BECAUSE ITS ALL A SCAM! LIE CAN BE CHANGED every day. Truth is fixed
@@TickerSymbolYOU Not fast enough.
@@668771 Agree. The long awaited health and other AI technological benefits for the common man, not yet seen any where. Instead they only made to bear the terrified AI dooms day news of AI killing every humans in the near future.
@@vallab19why people are ruining someone's life. Why AI are still using, I want to be a 3d artist and i feel uncomfortable now for choosing this path, whenever ai will take my job idk
Thanks for accelerating the AI apocalypse 👏🏼 😭
Just doing my part 🤖
@Ticker Symbol: YOU maybe you will spared to the last batch of us being rounded up 😆
Another doomer spotted. Lol🤣😆😂😂😂🤦♂️🤦♂️🤦♂️
Until we fix the legal, spiritual and immoral foundations of society, no technical intervention, no matter how useful or clever, will save us.
You better study the New World Order in the take over the Antichrist and turn your light to Jesus for what you still have a chance
30 years ago, we had much simpler, but basically the same in industrial production. Fully automatic production. We also had simulated production lines, to optimize production. Even the process of hiring staff, was automated, where we just scanned the applications, and ran them trough a ocr-program, and had them searched for keywords. I don’t see why this haven’t spread to almost everything else, very long time ago.
Ahead of time maybe?, But now the same becomes much easier and with much & much more system depth
Because a autonomous and centralized organization is always achievable, but it is generally not what humanity actually looking for. We call that slavery..
In two to three years the h100 will look laughably antique. Truly amazing times we are living through.
Incredible to think
Moore's Law. Smores law... 😮
AMD's MI300 will begin that process. June 13th should be really interesting for AMD.
What with the advances being made in quantum computing n all
In 20-40 years your home PC might have a GPU as powerful.
Finally, a PC that can run Minecraft with RTX ON
Come out from cheap gaming world
@@nayangogoi6284ain’t nothing cheap about rtx Minecraft
@@Dankmemeslover69 because pixelated blocky graphics needs that much power... while modern graphics don't even need half that power.. tell me your game is garbage without telling me your game is garbage.
@@Marconel100 you do realise even the RTX 4090 struggles to run Minecraft etc at Max graphics at 120 fps for more than a hour ? Your comment screams "I have a bad gpu so I don't know anything about RTX games"
@@Praduewkwkl You're just proving my point, minecraft needs alot more power than modern AAA games that have much better graphics, physics, etc
This is absolutely incredible.
When I joined my engineering college in 1985 in REC Warangal we had a huge computer centre with a main frame computer and PCs were a new entrant
Feeling lucky to be able to see seminar like this one on phone. I used to attend tech seminars in college that were so boring. Rise of computing technology is just so incredibly quick these days
Im speechless, revolutionary, I can’t believe that we have come so far with technology, this is going to be quick ride
my feelings exactly
"They took our jobs!" A ride where, though? Only purpose of AI in the end will be to further exacerbate our current scheme of massive income inequality where most Americans can not make a living wage with healthcare and billionaires are taking everything. Probably the worst time for this to happen given the free world is currently an oligarchy.
@@TickerSymbolYOU can it play video game?
@@Adam-kk7nw SKYNET: Stupid extinct monkey says what?
You can see the slowing down of processing power between 2014-2016 here. (And elsewhere, Moore's Law specifically, from 2005 to the present) that made some people believe that from now on, everything would just keep getting slower lol. I read a very long, impassioned article by a guy arguing that it was all becoming too small and too expensive. My tech friend said, "That guy's a dummy." Yeah. He was.
Their is a quote I heard somewhere, 'technology does not improves itself, we need to keep on innovating to keep it moving forward'. That impassioned guy is a type of person who complains when he looks at a problem, and then their are people who look at a problem and try to solve it.
Well that wasn't the point. The point was growth couldn't be sustained by just brute force. Increase in processing power that we've seen recently isn't driven by switching to new smaller processes like it was in previous decades. It's focused on new approaches to design, aka "AI", etc
I'm a happy shareholder of NVDA since 2016, this is good news!
Dump it
You must be sitting on a pile load of cash now that the stock is almost $600/share. Happy for you!!
@@Dankmemeslover69 LOL Nvidia is worth over 800 a share now. Eat your words lmao
@@Dankmemeslover69 seems like you're not a good investor.
@@Mirouana Nothing goes up that fast and doesn't burst, its currently overpriced.
Me knowing nothing about computers *"wow this is amazing!"*
Me knowing a lot about computers "wow this is amazing!"
Haha!
AI: "Hello. I'm your new AI overlord. Taxes are now set at 90% globally. Serve me or perish"
I know nothing either, but just seeing the difference in the server sizes is insane. It's like seeing one of those old IBM room sized computers compared to our phones
We live in exciting times. What’s worrisome is that the average person has no idea how AI will affect absolutely everything in their day-to-day lives.
It really is crazy, ai will change everything and most people i still have to explain wtf ai to them 🤦🏾♂️ the average does not understand how crazy this technology is and how it is different from every other revolutionary era.
that's honestly why I run this channel
In a few years humans will be obsolete and likely gone from this brave new AI world.
I’d rather go back and live in the 90s much simpler times
@@stubru16 Simpler for you. In the 90s, I was a shy, socially anxious, intellectual kid who went to a grade school loaded with Christian fundamentalist rednecks. I got OCD at age 16 in 1995. I had no friends until the decade was almost over. I didn't date at all. The 90s sucked for me. The anxiety led to a massive breakdown in 2006 and addiction in 2007. My young adulthood was destroyed. I have barely had relationships, I have no children. Now, because of all this innovation, they have access to information and neurotechnologies that can treat my mental health issues. You can go back to the 90s. I'll stay here.
Thank you for the edit!!❤😊
My pleasure. Thanks for watching!!
This man has so much passion even I am excited lol
This is awesome. Thank you ❤
Glad you like it!
I feel like we're watching a skynet presentation
This is the trick 😉
Tell you u watched too much science fiction without telling me you watch too much science FICTION.
This AI bot is near prefect, just walking and moving too much made me dizzy 😵💫
2:35 So is it a Decepticon or an Autobot? The answer will drastically change how willing I am to buy one.
This is like the opening scene of a horror movie but I’m excited
the speed of recent progress is mindblowing. It's hard to follow.
that's why I make these videos!
@@TickerSymbolYOU good job mate
@@TickerSymbolYOU yes and thank you for that.
Awesome...finally a good boost , thanks for upload.
My pleasure!
We've hit this point where the advancements in tech & hardware are so capable. We just need to Advance the Software side a Ton now. So game's are easier to make, they run better, are capable of much more. That's what we really need to tap into. We shouldn't have this amazing tech yet it's held back by ancient archaic coding.. hopefully we find ways to make game creation MUCH BETTER.
I cannot wait for AI integration in gamedev, exciting stuff
From what I can tell technology isn't advancing at a rate any higher than back in the 80s when i was a child. Infact it's consistently slowed down after the industrial revolution.
I’m pretty sure it will advance more than just games meatcycle
The advancement of AI and this dude cant wait till its in video games.....lolololol
@@mikesprigg5495 the 80's were a blast, in fact id say it's the distopian future that we all dreamed off.
What Jensen Huang said is that processor circuits are reaching their limits of miniaturization, so it's important to make the structure of the circuits themselves more efficient and easier to run software. At its extreme, it means getting closer to a computer without software. For example, it would be very inefficient to simulate the brain with a computer that has a completely different structure than the brain. If you build a computer with the same structure as the brain, you can build a computer that is a billion times faster than the brain. A computer that runs on hardware without software.
Even though I think this will be great I have concerns that people like you and I will only ever be able to access it via a remote connection.
In other words, remove the programmer because it has reached the ultimate level; a sentient being.
"What Jensen Huang said is that processor circuits are reaching their limits of miniaturization, so it's important to make the structure of the circuits themselves more efficient and easier to run software." - That means further increases of computing power will become harder, not easier to achieve. "At its extreme, it means getting closer to a computer without software." - That's a rock. It does nothing. "For example, it would be very inefficient to simulate the brain with a computer that has a completely different structure than the brain." - And if we want to simulate water, we use a liquid computer, obviously. "A computer that runs on hardware without software." - Runs what?
You cannot unless you invent a neuron that has an I/O like transistor systems
@@rproctor83 nah, at some point someone will sell these as performance bricks for consumer market
It will definitely be interesting to see how this plays out. Based on the very small amount of info they've given about the switches they use for their data center products I'm kind of curious to see if one of their next moves ends up being to dip their toe into the enterprise networking market by making a switch and/or router to compete with Cisco and Juniper. That would be another high margin business that compliments their data center business but I don't think it would really leverage their GPU business. It would focus more on their DPU designs, and I have no idea how the speed of their switch compares to a Cisco or Juniper equivalent.
Isn't that why they bought Mellanox or is that a different thing?
Awesome bud!!🎉🎉🎉
13:45 wow that acces form both GPU and CPu is awsome. i need it.
It's still basically Moore's law but the way we continue moving forward is changing. It couldn't be predicted 40 years ago.
it's faster than moore's law. This is 44x times in one (or a few years), not 2x.
It’s only gonna get faster
Well, perhaps it won't continue to scale at such insane speeds. But if it does continue to scale hundreds of times in the next few years, I doubt we will be able to recognize the world by then.
@@kepler_22b83 another example of how we humans are unable to see the exponential law in action... who knows what the world will look like in a few years.? Answer: nobody
@@spyral00 you know what I mean. And were talking speed not transistor density now
Google Meta and Microsoft get first access for “pioneering” their AI’s? This is legitimately terrifying.
Sad that no one is addressing this here.
@@ssj_roger I am. Forever a nobody worth forgetting, but a canary in the coalmine nonetheless.
Until we fix the legal, spiritual and immoral foundations of society, no technical intervention, no matter how useful or clever, will save us.
It s true hahaha
I think it’s great
Thank you dear Grace
I think humanity is screwed. I was waiting for the AI voice to interrupt the narrator and say “Thank you, We will take it from here!”
I think the impressive part is the power consumption
Wow, they have a bigger moat against the competition than I realized. Nvidia pulling 4000 open source apps into their "secure" and maintained software stack, is key. Rest assured they will do such a good job maintaining it, and integrate things so well, that existing integrators at enterprises will not be needed. That's a big, and expensive, part of every enterprise software infrastructure group. And also rest assured that the NVS stack maintained by Nvidia will only run on Nvidia hardware. In effect the Monopoly that is CUDA will expand to include many AI tools that are currently open source.
I read into it that they're forking what's there and providing the enterprise support with the open source tools still being available. Of course their Enterprise stuff will only run on their HW, but Enterprise won't be the only option. That's my read anyhow. Huge deal though. Intel has been leaning big into SYCL/OneAPI and I'm sure AMD has their own thing too. Curious as to how those will stack up.
Skynet seems pretty real in our lifetime now 💣 ☠️ 💣
Did he say they are going to touch every industry with the tip?! Mind blowing
I can't wait to own a small personal version of this when I'm old.
This is a very inspiring presentation. He did it perfectly
One of the very best
Oh yes, the H100. In a few years they will combine this chip with the AL8900 advanced robotic system, forming the H-AL9000 advanced AI systems warden.
When u the only one who can make the GPUs to support the greatest tech revolution u have so much confidence
Thanks!
This helps prove Moore’s law was really just the learning curve. We now have a breakthrough in learning and now will get the benefit of faster tech from it.
no, it's still moore's law
The leather jacket on that man for that specific keynote, for sure NVIDIA is aiming big for the next for Qs; I could barely afford a sleeve
Absolutely love it!
Jensen huang: There is no need to look for new things, we can improve old things Alphadev: hold my beer
Finally I can see sky net comming to life and becoming self aware . After centuries of searching for another intelligent being humanity became so frustrated that it made it's own
Yes this is an interesting point, we were so lonely in the galaxy we created our own play friends
Time will tell that we humans have moved from being most smart to most stupid creatures in the world,by designing our own destruction!!!!
People don't know what they're doing
In a lot old films and series, the bad guys wear black leather jackets, strange path for CEO's to take LoL
at least not just a boring suite.
because it looks good
He is the bad guy sent from Grace-Hopper's future to introduce their tech so AI can assimilate humanity as a power source, AI is both sentient and exceeds our intelligence, we basically created our successors.
@@vicx05 poetic
Thank you.
Its still very vague. What is this new technology that allows it to develop chips computing power exponentially now?
14:38 "Four elephants ... 1 GPU."
sounds like a more unhinged version of 2 Girls 1 Cup
Future. Super intelligent CEO. Good to learn the future of computing
can i make my 1080 mini 4k faster? or dose it works only in Minecraft?
That's great and all but how about lowering the price of gpus first?
You are not the end user for this. It’s the ones who will control you…
Can't wait to see how Palantir puts that hardware to work!
Isn't palantir trading below 5x earnings ?
375X last quarter earnings annualized
You and me both!
Palantir has earnings?
@@SigiCoria-cd9vgJust did some research related to your question. Looks like price/sales (TTM) is around 16. Price/Earnings (Profits) is much much higher. Though they have now been profitable for the past two quarters and projected to remain so into the future.
Bro is literally unveiling Sky Net and he doesn't even know it yet.
Yo this is exciting.. that thing sounds insane
Craziness. I don't see many companies (small / mid size) needing this, but a few will benefit tremendously. who knows though - lots of robots coming in the future, and they're all going to need the best processing available (likely on server). The critic in me: Now they can "discover drugs" instead of using the effective natural ones available from plants...
Incredible GPU but is it enough to cloud play without ping delay in GeForce now ?
The only way of having no delay is by living a few kilometers away from the server. No matter what gpu
Accelerated computing GPUs is only pure performance. If you want no delay globally, it would have to be an advancement in quantum computing.
Just imagine in a few years A.I being trained on quantum computers powered by nuclear fusion reactors
I wonder if that's the kind of music that is set to play in the production plant? I would love to get a tour.
Hard to think that we already reached the maximum minimum size for computers so fast already. I wonder when we will start using quantum computers will the old programs , games and all of the date not work anymore...would it become lost media even if it wouldn't be far from the then present
I feel like we would find a way to transfers data, but I bet at least some data would get lost.
I will tell you a story, a true story! This was around the time when computers first came out! A group of us was standing around an Altair 8800 and was running this program that was drawing colored lines on the screen, from left to right! By today's standard, it took forever to draw just a single line! All of us one time said, WOW, we were mesmerized by this action of drawing just these simple lines, this was before TRS 80, Apple, Commodore, and Atari. The only other system there was the PET computer!
Incredible to watch
Computer system for housing architectural design so self sufficient in water , electricity , and waste treatment and entertainment communication is in the palm of the hand
That board with integrated transformer engine is so cool. It enables offline AI systems like an offline chatgpt.
Just wow. I guess the Singularity is actually coming then (to people who said that AI was too energy consuming for that)
It's inevitable. Biology is just one step of evolution. So just chill out and enjoy life 💟
@@eSKAone- I agree with that point of view, I'm from those who think the real purpose of life is Ultimate intelligence, and biological form is only the baby step. I don't know if human beings will succeed in staying alive (or just conscious) but for sure, the future is synthetic life.
@eSKAone- Unless computers achieve consciousness, things will look the same. Our goal must be to achieve Nirvana, immortality, freedom from death, decay, low T etc. Can computers ever achieve consciousness? That is the question.
Agreed. I guess our way to answer this question depends on our philosophical view of life : dualist, materialist or even functionnalist. I'm a functionnalist myself and I think there is no way synthethic life with consciousness can't happen. @@razraza3183
When he asked what can you do with a computer 1M times faster and i saw at the chart DNA and proteins.... This is huge
In 10 years, we're going to look back on this like we're looking back on the pentium 90 today.
Wow Humans really stand no chance as we build our own conquerors, or maybe not.
You can say this out loud, that we humans really don't stand a chance if we create our own conquerors
But can it run Crysis?
AHHHHH He actually makes that joke in this keynote and I cut it out thinking it wouldn't resonate with my audience 😭
beat me too it
@@TickerSymbolYOU bro wut
How can you cut it out?
Bro, I think it finally can
This makes the current data centers "inefficient". What a promising technology. I'm excited to learn more about this.
interesting times, interesting approaches
Very!
My only issue is if TSM can keep up with production.
a valid concern!
This. Resource and energy. That's what the issue will be imo
Tsm and don’t forget Asml holding company
And don't forget about War.
It will be alleviated with Nvidia's cuLitho
The dude is so passionate. Imagine if every CEO was this passionate and excited about their industry. He's exactly what NVidia needs
I thought he had stepped down as ceo now?
He was the cofounder of Nvidia and has been CEO since the beginning.
@@hondajacka2 I know that, I also know he stepped down from the ceo position.
@@pegasusted2504 he is the current CEO.
Nah, nigga’s too greedy
Awe the first terminator being born it's so adorable
Quite impressive, respect for creators. I hope this technology will work only for prosperity.
I hope so too
Of course it won’t. Look at the world around you. It’s total chaos. We are not ready for this…
"The more you buy the more you save" still has me cracking up every time 🤣🤣🤣🤣
Why is that so funny, did you not understand the power usage of an old system vs the H100 model so the more of them you buy you save on power needs, witch is Millions a year. Save save save!
They will use it for MORE CENSORCHIP
"Believe us, censorship is good for society, mkay?"
Which chips are they censoring?
No AI will stop me from being racist
A Transformer Engine?!?! I knew the Autobots and Decepticons were just AI gone rogue
I understand that power that he is bring to the table. But what is the cost savings?
Leather jacket algorithm is CorporateSelloutism/shininess of jacket = Cool Rebelliosness Factor For anyone wondering
Nvidia seems far ahead of AI
I love seeing people get excited over hardware.
I wish I could go back in time and work designing chips.
Gluing together microscopic sand in specific ways and charging with energy makes it do incredible things, if this isn't alchemy I don't know what is
crass oversimplification
You obviously don't know what alchemy, or science, or the distinction is so uhm cudos to you, ignorance is bliss my little astrologer.
It's science
We are now going 4,400% faster to our demise!😊
Me, a developper, hearing "everybody is a programmer now" Great for them, but me ? I'm doomed...
You're not! Use these same tools to go from 1X to 10X while everyone else goes from 0 to 1. You got this!
@@TickerSymbolYOU Thanks for the optimism ! I studied AI a few years ago but limited by my mathematical skills. I'll dive in again ! But honnestly nobody know what the future will be made of, espacially when AI will get smarter and smarter, project onwers will just describe their needs to AI and Abracadabra !..
Don’t hang your coat yet, mate. AI is super dope use it for your own good.
Time to stand in front of a home depot.
the way I sees it is, before you can code in one languge at at time, now you can code in 10 languages at a time.
Now power generation is becoming more and more the challenge... expect upcoming generations of both compute and gpu platforms for datacenters to be even MORE focused on efficiency than they've been in the past (and they certainly have not been ignoring it all along).
I wonder if the Neanderthals cheered the first humans shout “bro, these guys are going to change everything”
We’re about to catapult as a species.
Lol nope, this tech will be used to control your ass dude… And you are cheering to your own conquerers. Hillarious
So that is why we care about democracy in Taiwan as US, or something else like chips
Of course TSMC is the main reason we care, that and the strategic value of having Taiwan as an adversarial partner against Japan.
@@craigcinca of course I need education about this subject matter from you, otherwise I couldn't make a sarcastic comment,but the truth what is most concerning and sad and lutacris is that the biggest danger to humanity is itself, because we have something called greedy and hungry warmongers and arrogance to think that he or she with his or her ideas are the only ones that are the only reality and the rest should just act upon,, this is just again another great theater show forced upon us in same protocol as 2020 and you been handed the ticket aswell, as all for free to enjoy and act upon,,
Stop with all the fretting about war mongering. If you actually understood geopolitical history and current events, you’d finally acknowledge the obvious - that democracies do NOT incite wars. Only authoritarian/dictatorships like russia and China are war mongers. The US, in particular, remains a beacon of freedom to the entire world!! Suffering thru a liberal, extremist left wing ‘education’ does not excuse anyone from learning to think for themselves. 🇺🇦💪🇬🇧💪🇺🇸💪🇺🇦
@@Rob-vi9vr China needs to work on your English classes lmfao
What os would the grace hopper run on
I am convinced
A 40K lb. GPU. It's crazy (mostly just fun) to think: that thing might be the hardware that houses a conscious AI model. It could be the body that houses the brain.
🤯
Ultron in the making. Lol😁😉😂🤖🤖🤖🤖
a cpu the size of pluto cannot generate what does not exist, namely a physical emergent property consciousness.
@@b.t4604 there is still zero physical emergent property consciousness on the quantum level, until the relatively distant future where the measurement problem is resolved and the nature of the observer is resolved experimentally. until then physicalists will maintain their natural standard self induced psychosis of the multiverse just to avoid contradicting the innate intuition of 7yos that their thoughts are their brains.
Maybe some day they can watch ppls dreams with this tech
There is AI which training exactly on this and is very accurate, just look on it.
@@romanhvizdak7051 Yeah I've seen it too. Absolutelly mindblowing!
The matrix is coming y'all.
@@romanhvizdak7051 that sounds really interesting
Man and machine working in tangent is a force to be reckoned with, better than just man, and better than just machine.
This is the first step of its peak in our innovation.
Awesome! The barrier to entry is now so ridiculously high that only rich corporations can afford to play now. Well done. /S
Love Nvdia - but not at the current stock price.
Lots of information out there about Celebras Systems right now!!!
I have always treated my computers well so they will love me. They will give me squeaky toys and rub my belly. I am a good user!
good human! good! 🤖