Some days, I get to do very cool things. Today was one of those days as I was able to attend the IBM z17 Event where the newest IBM mainframe was launched. IBM flew me out and asked if I could write a LinkedIn article, so we have to say this is #sponsored as well I think. Still, I wanted to bring the content to our STH main site audience.
The IBM z17 Mainframe Brings AI with Telum II and Spyre
At the IBM z17 Event, the company announced its new Mainframe built around the new Telum II processor. We covered the processor at IBM Telum II Processor and Spyre AI Updates at Hot Chips 2024 so you can check that out for a bit more detail (or just IBM’s site.) Still, today, I got to see the processors in action and hold them.
IBM had not just a z17 cabinet, but the one I spent more time with was the plexiglass clad demonstration unit with various components cutaway.
As a quick recap, the IBM Telum II is the newest generation of mainframe processor with features like larger caches and a new on-die AI accelerator implemented as a CISC instruction.
Since Will T just asked me as I was writing this what those connectors are on the sides, those are SMP connectors that allow this chip to be connected to the other chips in what can be up to a 32 processor system.
The entire setup is liquid cooled, and IBM is moving away from just distilled water to a new fluid for an easier lifetime of maintenance.
We have a better die shot on the LinkedIn article, but these liquid cooled sockets hold two Telum II dual chip modules.
Something I did not appreciate before today was that the motherboard in the system is very thick. I think I lost count at what looks like 40-50 layers. This cutaway is actually in the center of a forest of memory modules.
Here is one of the rear I/O expansion drawers at the rear. This is where the new Spyre AI accelerators go.
The IBM Spyre accelerators are 75W 128GB parts that are designed to be combined in sets of eight (up to I believe 48 per z17) for 1TB across eight accelerators.
The AI acceleration is important. Mainframes process the world’s financial data. There is an important task of performing fraud detection as close to real-time as possible. As bad actors use AI to commit fraud, more powerful AI driven algorithms are being developed to detect fraud which can have a significant ROI for these new systems.
Moving data around the mainframe is a DPU. This helps offload the task of getting data to I/O or other parts of the system.
Something that we will get into more over the next few weeks is how all of these parts, down to using PCB over wires helps increase reliability of the system.
Final Words
Perhaps when folks think of many cores, lots of memory, liquid cooling, and AI their first instinct is not to dream of a mainframe. That is exactly what this is though. We have gotten requests to (and I have wanted to) look at a mainframe platform for some time. Stay tuned for the full video on STH coming later this month. I had the opportunity to spend today with IBM’s team going through the system, and will be getting some behind-the-scenes footage this week as well to show you what goes into this system. Given these are designed for highly sensitive transaction processing, some of the design decisions are very different. I know only a portion of our readers use mainframes, but there is some really cool technology here that I know STH’ers will enjoy.