Sponsor Presentation—Advancements in High-Performance AI/ML through PyTorch's Python Compiler

Meredith Ringel Hammer
Ai

Discover PyTorch's Python compiler, Dynamo, designed to prioritize user experience for AI researchers, with dynamic control flow and ability to handle input changes, showcasing 93% successful model deployment.

Key takeaways
  • PyTorch’s popularity is largely due to its Pythonic approach, which makes it easy to use.
  • The project’s success can be attributed to its early adoption of a comprehensive set of Python features, collected by the PyTorch team.
  • The compiler, Dynamo, is designed to prioritize user experience, particularly for AI researchers, and is not a static data flow graph.
  • The compiler executes a program line by line, recording or tracing each PyTorch operation.
  • The compiler emits code for run on GPU, and generates code for dynamic control flow, allowing it to handle operations like input changes.
  • TorchScript is an earlier attempt at adding a compiler to PyTorch, which worked by tracing the execution of a program and generating a graph.
  • The Torch.jit.trace compiler works by adding guards to handle operations that weren’t captured by the PyTorch model.
  • The new compiler, Dynamo, takes a different approach by splitting the effort into three steps: graph acquisition, graph lowering, and graph compilation.
  • The compiler can handle dynamic control flow and is not limited to static data flow graphs.
  • The results show that 93% of the 80 models worked out of the box with the new compiler.
  • The compiler is designed to work with upcoming experimental hardware and is still under development.
  • The project is open-source and welcomes contributions.
  • The developer community is active and provides support through the discourse forum.

More talks

Kubeflow Explained: NLP Architectures on Kubernetes • Michelle Casbon • YOW! 2018 Michelle Casbon mephisto: Smart Factory: Wie Timeseries-Daten klassische Industrien verändern und zukunftsfähig mach - Peter Müller Keynote: Elizabeth Barnes- Explainable AI for Climate Science: Opening the black box to reveal earth Elizabeth Barnes AI Tribes 2024 : Balancing the Equation Ethical Strategies for Bias Free AI Kate O'Neill S1E2: "Software engineering is like a character-building video game" with Nick Means Nick Means Whispered Secrets: Building An Open-Source Tool To Live Transcribe & Summarize Conversations - Aaron Meurer - Toward Array Interoperability in the Scientific Python Ecosystem | SciPy 2023 Aaron Meurer KI Park - AI can improve our lives. We are working on it | Rise of AI Summit 2020 KI Park