APPLE'S 'FERRET' IS A NEW OPEN-SOURCE MACHINE LEARNING MODEL
Researchers from Apple and Cornell University quietly released an open-source multimodal LLM in October. Ferret is a system that can refer and ground anything anywhere at any granularity in an image. The model can examine a region drawn on an image, determine the elements within it that are of use to a user in a query, identify the elements, draw a bounding box around the detected elements, and answer questions about the elements. Ferret's release shows that Apple is starting to be more open with its AI work.