AMD Threadripper Halo Station Unveiled at IFA for Massive Local LLMs

AMD remained rather tight-lipped about the actual specifications during the press conference, as the focus quickly shifted to SUSE Linux and their partnership. The exact configuration is likely not final, but it will be based on the Ryzen Threadripper PRO 9995WX with its 96 Zen 5 cores and 192 threads. In addition, the system will be equipped with up to 2 TB of DDR5 RDIMM RAM. The RDIMM RAM offers a bandwidth of 410 GB/s, and the total system bandwidth is expected to reach 16.4 TB/s. This suggests that these systems will certainly cost well over €10,000. AMD did not specify a price.

It was evident that both the Threadripper PRO 9995WX and the two Instinct accelerators are kept at low temperatures using a 360mm liquid cooler. AMD aims to ensure that full performance can be maintained, as all three components generate massive amounts of waste heat. AMD has not yet revealed which Instinct accelerators are being used. Together, however, they are expected to feature 576 GB of HBM3e memory—that is, 288 GB per card. The GPUs’ bandwidth is expected to reach an average of 16 TB/s.

The Threadripper Halo Station is set to launch in 2027, and we expect AMD to provide further details at CES, as the product’s specifications have not yet been finalized.