APPLE COLLABORATES WITH NVIDIA TO RESEARCH FASTER LLM PERFORMANCE

Summary from the TLDR Web Dev newsletter

Apple and NVIDIA collaborated to integrate Apple's ReDrafter technology into NVIDIA's TensorRT-LLM, resulting in a 2.7x speedup in large language model text generation on NVIDIA GPUs.