Key Topics: AI infrastructure evolution Server and rack engineering innovations Analog components and power management Semiconductor industry growth and GPU impact Enterprise and hyperscaler strategies for differentiation Cooling technologies and hybrid solutions Networking and infrastructure for AI workloads Multi-cloud and on-prem AI deployment trends

EP 180: HPE Reflections on AI Compute Racks, Analog Analog Analog Semis.

The Circuit

Hello everyone, welcome to another episode of The Circuit. I am Ben Bajarin. Greetings, programs. I'm Jay Goldberg. So, there wasn't a huge news week. However, I was at HPE Discover and had a number of interesting observations and takeaways. I sort of joked if anybody saw, you know, on Twitter that this is my life now when I see an open compute tray.

I put my reading glasses on and my phone into magnification mode and I go look at silicon, names of vendors on silicon, MLCCs, power capacitors, you name it. Which, you know, is partly the, I like to see how these things are designed and built and the engineers on the floor are generally very excited to answer very technical questions.

Something that I greatly appreciate about these shows. Um, cause they're not just, oh, this is what it can do. It's like, oh, that's why this is where the power thermal lays. We designed it this way so that we could squeeze out X, Y, Z of efficiency or network latency. I'm like, this is, this is the greatest conversation ever.

Um, but, but there was a couple things I'm taking away from this and I don't know how to sort of frame this in the analysis because it is technical, but basically, you know, there's a discussion out there around how everybody designs their infrastructure. So, you know, we know, right. Amazon, uh, with AWS or Microsoft with Azure or Google with GCP, you know, they design a lot of these racks, right?

They don't just buy, you know, NVIDIA GPUs and go with everything or even for their TPUs, right? They are engineering the crap out of these, uh, racks for something, you know, again, everybody's variable changes.

EP 180: HPE Reflections on AI Compute Racks, Analog Analog Analog Semis.

Read the full transcript

The candid version is on a podcast,
not the earnings call.

EP 180: HPE Reflections on AI Compute Racks, Analog Analog Analog Semis.

Read the full transcript

The candid version is on a podcast, not the earnings call.

The candid version is on a podcast,
not the earnings call.