HOW SHOPIFY TURNS OPEN MODELS INTO TASK EXPERTS

Summary from the TLDR Data newsletter

Shopify trains and hosts specialist open models for Sidekick's focused tasks, using production failures and human feedback to improve them. Its GraphQL specialist slightly outperformed the frontier model on Shopify's evaluation while responding 7x faster and costing about 90% less to serve.