PERPLEXITY'S INTEGRATION OF GPT-OSS MODELS

Summary from the TLDR AI newsletter

Perplexity has detailed how it integrated OpenAI's gpt-oss-20b and gpt-oss-120b models into its in-house ROSE inference engine on NVIDIA H200 GPUs. The post covers kernel adjustments, quantization trade-offs, and the minimal infrastructure changes needed to support the models on non-FP4 hardware.