LLAMA 3 405B INFERENCE

Summary from the TLDR AI newsletter

Cerebras has the largest Llama model, running 12x faster than comparable systems and 18x faster than some closed model API providers. It can run at almost 1k tokens per second. It will be available via API at the beginning of next year.