PyTorch Conference has ended
October 16-17, 2023
San Francisco, CA
View More Details & Registration

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for PyTorch Conference to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration. 
Back To Schedule
Tuesday, October 17 • 4:10pm - 4:20pm
Lightning Talk: Building Intermediate Logging for PyTorch - Kunal Bhalla, Meta

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
One of the best ways to understand what's going on with your model is to actually look at all the numbers flowing through it. In this talk I'll walk through implementing an API to capture all values as they flow through a PyTorch model: Module arguments, parameters, buffers, return values -- as well as gradients -- in a way that Just Works even if you're using TorchScript, torch.compile, transforming the model with Torch Fx, distributing it with torch.package or just pickling it and passing it around. We'll end up talking about several Python and PyTorch internals along the way. Having all the numbers available opens up a lot of opportunities to understand and debug your model as well, and I'll also talk through some case studies, though I'm far from a domain expert there.

avatar for Kunal Bhalla

Kunal Bhalla

Software Engineer, Meta
I've been moving up and down the stack as at Meta for a decade: working across site reliability, mobile battery optimization, smoothly animated maps, custom notebooks implementations and most recently: making debugging models easier.

Tuesday October 17, 2023 4:10pm - 4:20pm PDT
Grand Peninsula Ballroom A/B/C