TLDR Web Dev · MISCELLANEOUS
DESIGNING THE BUILT-IN AI WEB APIS
Summary from the TLDR Web Dev newsletter
Chrome's AI team is building web APIs that let users run AI models directly in the browser, aiming to make these capabilities standard across all browsers. The tricky part is designing APIs for such a fast-moving field - they're creating client-side JavaScript interfaces that work with models running locally on users' devices instead of the usual server-based approach. Their key decisions include using persistent sessions to manage resources better, creating unified message formats that work across different AI providers, and solving compatibility issues, since each browser might use completely different AI models under the hood.