LLM INFERENCE SPEED OF LIGHT

Summary from the TLDR AI newsletter

Using theoretical speed of light modeling as grounding is really important for problems where the amount of computation and memory access is known a priori as it helps validate the quality of implementations and predict the impact of architectural changes.