Huang noted numerous examples of Nvidia’s ecosystem in action, including Microsoft 365 and Azure users gaining access to a platform for building virtual worlds, and Amazon using simulation capabilities to train autonomous warehouse robots. He also mentioned the rapid rise of generative AI services like ChatGPT, referring to its success as the “iPhone moment of AI.”
Based on Nvidia’s Hopper architecture, Huang announced a new H100 NVL GPU that works in a dual-GPU configuration with NVLink, to cater to the growing demand for AI and large language model (LLM) inference. The GPU features a Transformer Engine designed for processing models like GPT, reducing LLM processing costs.
