OPTICAL CONNECTIVITY DIRECTLY IN THE GPU

Summary from the TLDR AI newsletter

GPU interconnect bandwidth is one of the primary bottlenecks in training large models today. Broadcom is working to integrate optical transfer directly into GPUs which would alleviate the issue substantially.