Supermicro 1U Ultra AMD EPYC 7003 Milan Server Review
STH Main Site Article: www.servethehome.com/supermic...
STH Merch on Spring: the-sth-merch-shop.myteesprin...
STH Top 5 Weekly Newsletter: eepurl.com/dryM09
In our Supermicro AS-1024US-TRT review, we show the dual AMD EPYC 7003 "Milan" server's features and why the server has this unique design
----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
01:06 Naming and Market Positioning
05:20 Hardware Overview
08:53 AMD EPYC Milan and Performance
10:57 Memory Configuration
11:30 Why a Custom Motherboard
15:28 PCIe Configuration
18:15 Rear IO and Networking
22:23 The Ask
24:05 Wrap Up
----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
- AMD EPYC 7003 Milan Launch - • AMD EPYC 7003 Milan Pe...
- Intel Ice Lake Xeon Launch - • Intel Ice Lake Xeon Re...
- Intel Optane DIMMs - • The Glorious Complexit...
- AMD PSB - • Vendor Locking AMD EPY...
Doing a side-by-side benchmark/comparison of servers would be pretty damn cool actually. I don't think I've seen that done on any channels yet. But then again, there aren't too many channels I'm subbed to that deal with servers at all. I would love to see it, and to learn more about the whole server space :)
I'd love to see them compared with a roughly equivalent dollar value configuration, and a benchmark of something like how many low end VMs can you cram into each machine before it melts lol
Another STH premier epic review video! Thanks for being the eyes and ears for this... Quite enjoyable!
I like names that say something about the product instead of marketing bs
I would love to see the cage match of Milan vs Ice Lake. Video and/or Article. Great video, appreciate those STH insights.
I like Supermicro's product SKU system. Once you figure it out, there are very descriptive and easy to remember (for me at least)
x ., the world zezz set e as
x ., the world zezz set e as
I will never be able to buy one of these, but it's still cool to know they exist.
You'll be surprised how cheap they'll be in 5 years (second hand on eBay).
No one will. They won't ship. AMD can't even FULLY supply what Sony and MS want - much less desktop and GPUs - an certainly not turdrippers and epycs... Ice Lake SP shipping is MASS volume permanently slams the datacenter door in AMD's face.
You may never own one, but you will almost certainly use one.
@@godslayer1415 Uhm... they are shipping now. I resell servers and we have pretty much gone to exclusively Epyc. Epyc completely destroys Intel's offerings and a lower price. Price/performance ratio is not even close. I have never had an issue with availability with Epyc. We have seen delays in Intel in the past, though.
@@godslayer1415 server parts are bring much more profit margins, so they are usually prioritized
With regards to your ask, it's not servers but workstations that interest me: I'd like to see an evaluation of a Threadripper Pro against an Ice Lake Xeon, both on workstation motherboards.
Ok that is fair. A bit hard to do on Ice Lake given constrained availability.
Do both
yes please do the comparison it will be interesting
I'd be interested to see an ice lake apples to apples. It's be really interesting to try to spec them identically either with the same core count or same cost. It's also be interesting to hear about real world pricing comparisons, even though I know vendors and manufacturers hate that.
@serveTheHome Great information. Would like to see the 50U rack and how that is linked 10G to the Top of Rack Switch and HBAs Also the Intel Video. The other opportunity is discuss maximum CPU clock on servers (probably 2U due to heat and wattage of PSUs) vs maximum cores with this having 64. What is the HPE version of this and the Intel Edition please? Is SuperMicro doing onboard water cooling or external cooling instead of using so many fans and power for fans?
I think engineering names are fine since their target market is professionals in the computing field. For the consumer market, it's probably better to establish more human friendly names.
You should tell Intel that, the USB-IF too
Consumers are deluded to great lengths already. I'd rather request thorough documentation on what's inside the products.
Hey Patrick, curious when "civilians" will be able to buy these servers from resellers or purchase individual AMD Epyc Milan Cpu's? Any resellers you recommend? Thanks!
yes Server benchmarks would rock.
A bit at "08:53 AMD EPYC Milan and Performance" but then also on the STH main site. We did more in the Ice Lake Xeon launch piece for Intel v. AMD
I'd be more interested in a head-to-head comparison of similarly-specced servers from Supermicro, HP, Dell, Lenovo, and Gigabyte to point out what they do differently (instead of an AMD vs Intel comparison, as I think the differences there have been pretty well covered at this point). On paper, everybody has similar specs and capabilities. A review showing the more subtle differences that you really only know from hands-on management, the quirks of each, policy differences, etc. That would be something I haven't really seen covered except anecdotally in forums.
Love to see a comparison between xeon and epic, please do :)
Comparison would be fantastic
All flash EPYCs Milans should be able to support multi-terabytes throughput in theory. If you got some or multiple 100G or more NICs laying around, I would like to see how this super high-end system handles very high speed networking. For instance can it transfer say 10TB of data in less than a minute ? What are the limits of NIC aggregation, can Milan support multi-terabytes communications ? That's what I'm hopping to see Patrick Cheers
Quick question, can you post showing the air shroud as the PDU looks like it blocks the CPU air flow. Thank you. :)
John, adding something to a published video is not going to happen. We do have more photos on the website, specifically page 2 is dedicated to the internals. We literally had this system running a consistent "100%" CPU utilization workload for a week and it stuck right at 739W virtually the entire time without causing fans to spin up higher so the cooling seems to be working.
17:43 do i see a blue and a black USB3 header? IMO, unless this is going to be used for sort of a sudo DOM, this an odd choice when C heatders are much smaller
You mentioned several times that these systems are pitched at competing with HPE/Lenovo/Dell - how would you rate that comparison? I run supermicro in the lab and have used HPC systems based off of SM building blocks but they've always seemed to occupy a middle ground between the pure whitebox and tier 1 system builders. It's interesting to see players like Gigabyte, Asus, and Tyan moving more into that middle ground in recent years
That is not a bad way to look at it. I do think that each vendor has cool innovations from time to time. Supermicro is always a bit focused on being more industry standard management v. proprietary iDRAC/ iLO/ XClarity and also lower costs... but then with some very customized models off the shelf. Over the years, we have been using Supermicro in some part of the hosting infrastructure and the only issue we have had on a SM box was getting hit in our firewall by an Atom C2000 bug after a data center power glitch. That is an Intel issue that hit Cisco and others as well so hard to say that is a SM defect.
I'd love to stuff that with a Bunch of high power GPUs and have it be home server powering a bunch of thin clients around the house as gaming and content creation hubs
AMD vs INTEL platform server comparison would be really cool to see :D
Here you go Intel - shipping in high volume AMD - can't even fully supply the console makers - and won't be making these even in the 100s of units.
If you have the decoder ring, Supermicro's naming 'just makes sense'. I swear I'm not an engineer ;)
Is it possible to "build' a 2 socked AMD EPYC system? I know there are EATX form factor motherboards available. What would one need to consider when building such a system?
You can, but it is a bit harder. You will likely only get 8 DIMMs per channel. Cooling may be a challenge. Also PCIe expansion may be limited. Often a similar price just to buy a pre-configured system.
🤤 God Dual Epyc CPU.. Imagine the amount of transcoding H.264 I could do with this thing while sending feeds to a bunch of CDNs..
would be really nice if some level of benchmarks (even if brief) were performed on them
There are more on the STH main site, but that is in the "AMD EPYC Milan and Performance" section. Also used a few different CPUs for comparison in what one can configure. New chips just arrived yesterday afternoon so we were a bit limited in what we could put in here.
@@ServeTheHomeVideo oh awesome! Didn't see that previously, will check it out.
What I would be interested in would be any Epyc based system with 2x40GbE + 4 slots for FC HBAs... Upgrades are looming.
40Gbe is old news, SFP28 is the new hotness - 25Gb, 50Gb, 100Gb, etc.
Yeah, those power supplies only do 1kW on 240 volts. Do they need a hot and a neutral, or can they run on two hots? I've always been afraid to test such a thing with PSUs.
In the US, pretty much all 208v or 240v electricity is via 2 hots and the ground (just for safety). Household electricity is split phase, meaning 240v between the two hots or 120v between each hot and neutral. Commerical power is three phase with 208v between any two phases/hots or 120v between any phase and neutral. I can personally confirm that HP common slot server PSUs will work with no problem on either. I'm not sure if outside the US they have 240v between hot and neutral, but if so I'm 99% sure that would work too. Given the way alternating current electricity works, I'm not sure the PSU could even tell the difference once connected. Anyways, there's a reason lots of stuff is rated 90-240v, it's because that means it will work pretty much globally.
@@tinfever I know the information about what 240v is. Europe is 220v with a hot and neutral. They're what the PSUs with the little red switch is for. People have asked about if they can be run on the US's 240v, and the usual reply is that it is not a good idea. Just do a search about it and read the electronics jargon as to why they say it may not be good.
I think you should state on each server review if they 'vendor lock' the CPU?
We discuss that on the main site review very briefly. So far Dell and Lenovo are confirmed but this seems to be OK.
Yes, do a side by side
Ice lake vs Milan. hell yeah!
This supermicro 1u platform is the only 1u box allowing for two single slot gpus or a dual slot gpu. Not about the cpu platform. Just how their proprietary mainboard is designed. What is kind of contradicting is supermicro's website on sata. As far as i understand epyc cpu's and the mainboard manual, nvme and sata is provided out of the box by both, while the backplane manual and the website of that server box kind of tells you to get a addon kit for sata AND OR sas. I asked supermicro to clear things up for the twelve bay version. Still waiting. Do you know more about that?
I still need an optical drive. Being poor, I’m still making due with my HPE DL380 Gen 9 Dual Broadwell.
were i can by this ??
Sounds great for a super high density Monero farm.
I would be very interested to see performance tests between Intel and AMD based servers!
We cover more AMD-only configurations in server reviews since those are what you can configure in this system. AMD v. Intel we covered in the linked video around the Ice Lake launch (Milan happened first so we could not publish Ice Lake numbers when Milan launched.)
Can you please enable automatic CC, if you haven't already? thank you
It is enabled
++ on that versus
I really wish that SuperMicro would just make their boards with 10G networking have SFP+ slots instead of 10GBase-T. I just wind up buying the versions with only 1G because I don't use it, and then install a 10G SFP+ NIC. If they had it onboard I would have one less AoC to deal with. I'm speaking in terms of their E-ATX boards, not these proprietary ones with configurable riser SKUs.
I think comparisons between servers would be useful, it would help put the computers into a context. You mentioned several times that these are premium compared against budget machines or other segments: how about a walkthrough of the two dozen different types of systems that supermicro has, point out the features that are premium, point out the parts of the cheap ones that are rubbish, compare noise levels, etc. Starting at their homepage and trying to find a machine is just baffling when you don't know which lines are best ignored, which lines are best value, which lines are best performance, etc. Thanks
I would like to see the side by sides
comparison of Intel vs AMD would be interesting
We cover more configuration options in server reviews, and in CPU reviews/ launch pieces we cover competitive. That is just to keep it clear. Years ago we had a reader try to order an Intel server with an AMD EPYC 7001 based on a review with both, and that was rough for me, as well as the vendor's sales team trying to explain. We have AMD v. Intel in our Ice Lake video and article.
@@ServeTheHomeVideo Hard to have sympathy for somebody that can order the correct brand CPU. In any event I see Supermicro as a neutral player, so comparing their AMD and Intel boxes should give a good perspective.
If I could, I would buy this thing and make it the worlds largest Plex server.
I think you should make the product name the recurring gag and go full overboard
8 TB RAM is more expensive than the rest of the system together 🤔
By a lot!
@@ServeTheHomeVideo Windows 10 can only address up to 6 TB ram.
@@tevhiddawah55 I'd be extremely surprised if anyone is running W10 on this system! It's pretty amazing that a *desktop* OS can address 6TB RAM, though
@@tevhiddawah55 but why would anyone run Windows 10 on anything? 😅 Just kidding I like Windows 10 specially with WSL2. But I prefer Linux..
that means you're not using the right SSDs lol
Good stuffs! 64 cores CPU
crack for simple minds
I think I watch these videos just to hear Patrick read the model numbers...
The vast majority of them I have to memorize since everyone said I looked like I was reading when I used a prompter.
whats wrong with the audio?
I have had just about enough of INTEL which is so yesterday, AMD is where it's at, the latest version of ESXI will run on the EPYC processor but I think that Linux Mint CINNAMON latest version should run like there is no tomorrow.
YAAASS, grudge match...Intel vs AMD, only one will survive!
Ah this is Server name not board
SuperMicro is still fixing our gpu servers that we gave them in December 2020. 😂 😂 😂 😂
0. 0
We just got rid of old Supermicro servers in favor of new HPs.
Why is he pronouncing "Mulan"?
Won't ship - unless AMD found some way to use wafers more than once.
I always wondered why AMD chose the EPYC brand name when Intel/HP had a chip that I always used in the past called EPIC - en.wikipedia.org/wiki/Explicitly_parallel_instruction_computing