A new technical paper titled “Lincoln AI Computing Survey (LAICS) and Trends” was published by researchers at MIT Lincoln Laboratory Supercomputing Center. Abstract “In the past year, generative AI (GenAI) models have received a tremendous amount of attention, which in turn has increased attention to computing systems for training and inference for GenAI. Hence, an... » read more The post MIT’s Survey On Accelerators and Processors for Inference, With Peak Performance And Power Compa...| Semiconductor Engineering
Just before Christmas, I've stumbled upon Machine Learning Engineering Open Book by Stas Bekman. It's a book I've long been looking for – a collection of insights on operating a large GPU cluster and using it to train and run LLMs: AI accelerators, fast intra-node and inter-node networking, optimized cluster storage, large-scale LLM training and inference, with lots of first-hand experience on these topics. I want to share my key takes from the book as well as other excellent resources I've...| Ten thousand meters
Nvidia surpasses Microsoft to become the world's most valuable company - SiliconANGLE| SiliconANGLE