CEREBRAS INFERENCE

Summary from the TLDR AI newsletter

Cerebras' chipset has massive unified memory. As a result, it can sidestep bandwidth issues and serve models at thousands of tokens per second.