talk-data.com talk-data.com

Microsoft Ignite breakout 2025-11-19 at 22:45

Interactive Session: Benchmarking LLM performance on Azure with NVIDIA Recipes

Description

AI performance extends beyond chip metrics; it relies on integrated hardware, software, and infrastructure. Traditional benchmarks fall short, so NVIDIA DGX Cloud Benchmarking offers a standardized framework to evaluate large-scale AI workloads. NVIDIA and Azure present an end-to-end benchmarking workflow, sharing optimization strategies for deploying and tuning production-ready LLMs on Azure.