TLDR Web Dev · ARTICLES & TUTORIALS

SPEEDING UP FIREFOX LOCAL AI RUNTIME

blog.mozilla.org6 min read

Summary from the TLDR Web Dev newsletter

Mozilla has accelerated Firefox's AI Runtime by replacing the WebAssembly-based “onnxruntime-web” with native C++ ONNX Runtime integrated directly into Firefox. This change delivers 2-10x faster inference performance for AI features like PDF alt-text generation (improving from 3.5 seconds to 350ms) and smart tab grouping, while removing WebAssembly warm-up overhead.