Karthik G VaithianathanUnderstanding the energy spectrum“Anything that moves by itself without any external stimuli contains life energy — karvai”Jun 24, 2023Jun 24, 2023
Karthik G VaithianathanFrom Exascale, towards building Zettascale general purpose & AI SupercomputersRecently, I saw an interesting slide (shown above) presented by AMD’s CTO Mark Papermaster, showing a need for a 40x improvement in energy…May 17, 2023May 17, 2023
Karthik G VaithianathanHow long will it take to train an LLM model like GPT-3?Teraflop/s is 10¹² computations per second, Petaflop/s is 10¹⁵ computations per second, Exaflop/s is 10¹⁸ computations per second, and…May 15, 2023May 15, 2023
Karthik G VaithianathanBuilding an Nvidia H100 Superpod Exaflop Machine for Deep Learning Training and InferenceIn this blog, we’ll see how to build an Exaflop machine using Nvidia’s GPU H100 based on its latest Hopper architecture.May 15, 2023May 15, 2023
