Time: Thursday, March 7th at 1pm
Location: 310 Sutardja Dai Hall (Banatao Auditorium)
Reception to be held prior to the event
Abstract:
Join Mark Russinovich, Azure CTO and Technical Fellow, and get an under-the-hood look at Microsoft’s AI architecture, including the large-scale supercomputers that train foundational models and the infrastructure that efficiently serves small and large pretrained and finetuned models. He’ll cover everything from how we design servers, to the AI-aware resource management service that schedules training and inference, to the AI-specific techniques we’ve developed for maximizing GPU usage. You’ll also get a look at advancements and opportunities in trending AI research and confidential AI.
Bio:
Mark Russinovich is Chief Technology Officer and Technical Fellow for Microsoft Azure, Microsoft’s global enterprise-grade cloud platform. A widely recognized expert in distributed systems, operating systems and cybersecurity, Mark earned a Ph.D. in computer engineering from Carnegie Mellon University. He later co-founded Winternals Software, joining Microsoft in 2006 when the company was acquired. Mark is a popular speaker at industry conferences such as Microsoft Ignite, Microsoft Build, and RSA Conference. He has authored several nonfiction and fiction books, including the Microsoft Press Windows Internals book series, Troubleshooting with the Sysinternals Tools, as well as fictional cyber security thrillers Zero Day, Trojan Horse and Rogue Code.
This talk is jointly organized by College of Computing, Data Science, and Society, College of Engineering, Department of Electrical Engineering and Computer Science, and Sky Computing Lab.