The AMD Helios with the MI400 will scale to 31TB of memory and 1.4PB/s of memory bandwidth per rack. It is so big, it needs bigger racks| ServeTheHome
The new AMD Instinct MI350 series scales up to 1.4kW and 288GB of HBM3E per GPU with a focus on AI performance| ServeTheHome
NVIDIA is making a strong move here against Broadcom, Astera Labs, and Marvell. It may, however, benefit cabling companies| Patrick Kennedy's Axautik Group LLC and ServeTheHome Stack