APPLE IN TALKS WITH STARTUP THAT SHRINKS AI MODELS TO RUN ON AN IPHONE

Summary from the TLDR newsletter

Apple is in talks with PrismML to shrink powerful AI models to run directly on iPhones. PrismML is known for reducing Alibaba's Qwen model from roughly 54 GB to less than 4 GB. The most capable models typically require too much memory and processing power to run on a smartphone, but running requests in the cloud presents security and other issues. Running AI directly on the iPhone reduces delay, lowers cloud computing costs, enables offline usage, and supports Apple's privacy pitch.