CUDA GRAPHS, 2.3X SPEEDED UP ON LLAMA 2

Summary from the TLDR AI newsletter

A great in-depth read about how to improve the performance of deep learning models using PyTorch 2.0's torch.compile and Nvidia CUDA graph features. This article is a gold mine for performance-sensitive AI folks.