DOUBLING INFERENCE SPEED AT CHARACTER.AI

Summary from the TLDR AI newsletter

GPU workload tuning and hardware-level optimizations reduced latency and cost across Character.ai's systems and doubled production inference speed.