PRISMML SHRINKS A 27B-PARAMETER MODEL TO 3.9GB, SMALL ENOUGH TO RUN FREE ON AN IPHONE

Summary from the TLDR Hardware newsletter

Caltech-rooted startup PrismML compressed a 27-billion-parameter model down to just 3.9GB, small enough to run locally on an iPhone 17 Pro's neural accelerators, or on iPad, Mac, and PC, while retaining roughly 90% of the original's performance. A model of this size normally can't fit in a phone's usable memory at all, making this a real test of how far Apple's on-device silicon can be pushed. Apple has confirmed early talks with PrismML about the technology.