讲座标题(中文): 理解、学习与使用PyTorch编译器(torch.compile)
讲座标题(英文):Understand, Learn, and Adopt the PyTorch compiler (torch.compile)
讲座摘要:
Machine learning compiler is an important tool to leverage new features in emerging domain specific hardwares and to scale up distributed training. PyTorch 2 introduces a compiler designed to accelerate deep learning programs. However, for machine learning researchers, adapting to the PyTorch compiler to full potential can be challenging. The compiler operates at the Python bytecode level, making it appear as an opaque box.
In this talk, we will demystify the PyTorch compiler step by step, and introduce the usage of an open-source tool ( https://github.com/thuml/depyf ) to help the understanding. We will also discuss some practical guidelines for adopting the PyTorch compiler.
讲者信息:游凯超,清华大学软件学院2020级直博四年级学生,师从龙明盛副教授,研究方向为机器学习、深度学习及迁移学习,曾获研究生国家奖学金等荣誉。