HOW APPLE FITS AN LLM ON YOUR IPHONE

Summary from the TLDR Dev newsletter

Apple fits a 3-billion-parameter model on the iPhone using compressed weights, shared caches, and small task-specific adapters. More complex requests go to Private Cloud Compute.