About the author
Patrick LeGresley
Patrick LeGresley is a researcher in the NLP group within Applied Deep Learning Research at NVIDIA, where he focuses on system aspects of training large language models. He received his PhD in Aeronautics and Astronautics from Stanford University. In the past, he also worked at the Baidu Silicon Valley AI Lab, working on systems research and deep learning for speech recognition.
Patrick LeGresley
Post by Patrick LeGresley
time-spent-per-iteration
By Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper and Bryan Catanzaro |