SAMBANOVA CLOUD: LIGHTNING-FAST INFERENCE WITH LLAMA 3 MODELS - FOR FREE

Summary from the TLDR AI newsletter

Need REALLY good performance? Achieve over 100 tokens/second on the Llama 3.1 405B model—far exceeding the average GPU provider's