Details: 

Join us for lunch in the Gates Computer Science Building, room 119, from 12:00 pm - 1:15 pm PT with an option to attend virtually through Zoom Webinar.

Abstract:

Join Mark Russinovich, Azure CTO and Technical Fellow, and get an under-the-hood look at Microsoft’s AI architecture, including the large-scale supercomputers that train foundational models and the infrastructure that efficiently serves small and large pretrained and finetuned models. He’ll cover everything from how we design servers, to the AI-aware resource management service that schedules training and inference, to the AI-specific techniques we’ve developed for maximizing GPU usage. You’ll also get a look at advancements and opportunities in trending AI research and confidential AI.