Transcript for:
Nvidia's Supply Chain and AI Integration

[Music] Nvidia operates one of the largest and most complex Supply chains in the world a single Nvidia Hopper dgx has nearly 40,000 parts from over 150 suppliers and weighs nearly 350 lb and the supercomputers we build connect tens of thousands of Nvidia gpus with hundreds of miles of high-speed optical cables we rely on hundreds of Partners to deliver thousands of different components to a dozen factories to build nearly 3,000 products a single disruption to our supply chain can impact our ability to meet our commitments to help us manufacture and deliver AI Factories at extraordinary scale nvidia's business operations team is developing an AI planner that lets us P to our supply chain data the AI planner is an agent built on Nim Nvidia inference microservices a Nim is a container with pre-trained models and Cuda acceleration libraries that is easy to download deploy and operate on premises or in the cloud our supply chain team assembles their AI planner with an llm Nim to understand planner's intention and direct the other models Nemo retriever rag Nim to connect the llm to proprietary data and and a kop Nim for Logistics optimization Nvidia coop is a state-of-the-art GPU accelerated combinatorial optimization library for operations research and holds an incredible 23 world record benchmarks operations research is the discipline of efficient decision-making for highly complex Logistics problems such as the traveling salesman vehicle routing or supply chain optimization problems Industries spend billions in rooting operations so large efficiency gains can easily save hundreds of millions in costs but accurately modeling and optimizing these scenarios is extremely complex these are intricate networks with numerous variables constraints and interdependencies that change in real time the resulting search space is many orders of magnitude larger than the number of atoms in the universe kop acts as a supercomputer for this type of decision- making using GP pu accelerated heris sixs and evolutionary algorithms it calculates an optimal route in seconds and dynamically recalculates when requirements change with kop as the optimization brain behind our AI planner our operations team can analyze thousands of possible scenarios in real time using natural language inputs to talk to our supply chain data let's look at an example where the AI planner automatically reallocates a product to customers based on changing conditions please show me what the new RTX 6000 allocation would be for attend customers with the highest demand if there's 40% increase in Taiwan Supply 3we production Falls in Hong Kong and 20% increase in global demand acknowledging constraints solving here's how this will impact those customers normally replanning such a complex large-scale supply chain would have taken at least overnight but with our cop powered AI planner it takes just seconds giving our team the Speed and Agility to respond to an Ever shifting supply chain