TLDR AI 2024-05-01

The window to invest is closing - learn more here.

META RELEASES EXECUTORCH FRAMEWORK FOR LLM ON EDGE DEVICES

Meta's ExecuTorch Framework is a post-training quantization toolkit that enables running Llama models on various iPhone and Galaxy devices. It is able to get as much as 11 tokens per second on mobile phones running 7B sized language models.

APPLE POACHES AI EXPERTS FROM GOOGLE, CREATES SECRETIVE EUROPEAN AI LAB

Apple has aggressively expanded its artificial intelligence capabilities by hiring numerous AI experts from Google and establishing a secretive AI research lab in Zurich, Switzerland. The lab, known as the "Vision Lab," focuses on developing advanced AI models that integrate text and visual inputs.

TEXT RETRIEVAL WITH FASTER EMBEDDING SEARCHES

Seismic is an innovative approach to organizing inverted indexes that significantly enhances the speed and accuracy of text retrieval using learned sparse embeddings.

EXPLORING MAMBA: A VISUAL FOUNDATION MODEL FOR ADVANCED COMPUTER VISION

The Mamba model is a state-of-the-art approach that excels in handling long sequences without the computational drawbacks of traditional Transformers.

ADAPTING GRAPH NEURAL NETWORKS TO CHANGING STRUCTURES

The Cluster Information Transfer (CIT) mechanism is a new method designed to enhance the adaptability of Graph Neural Networks (GNNs) to different and changing graph structures.

>> June 25, San Fransisco. Register here

CUDA CHECKPOINTING

A new toolkit from Nvidia that allows checkpointing the CUDA state for transfer and restarting. It is useful for distributed training of very large AI models.

FRIENDS DON'T LET FRIENDS MAKE BAD VISUALIZATIONS

Visualizing eval scores for models is key in today's AI research world. However, many charts are bad at conveying the intended information. This repository shows some great charts and comes with dos and don'ts for visualizing results.

META-PROMPTING IN LLMS

Meta-prompting is a technique that turns a single language model into a multi-skilled team. This method breaks down complex tasks into simpler parts, handled by specialized instances of the same model, leading to significantly improved performance across various tasks.

SPEEDING UP LARGE LANGUAGE MODELS WITH QUICK

QUICK is a new set of optimized CUDA kernels that boosts the efficiency of large language models by solving memory issues. This leads to a notable speed increase on NVIDIA GPUs, making AI models faster and more efficient.

DIDDO'S NEW FUNDING WILL BRING ITS SHOPPABLE TV AI API TO STREAMING PLATFORMS

Diddo is a CV/AI API for streaming and media companies that can make their content instantly shoppable without the use of QR codes or second screens, opening up new revenue streams for them. Diddo's API keeps the purchase capabilities on platform and 100% native so it is truly an end-to-end commerce solution for video owners.

COGNITION SEEKS $2 BILLION VALUATION FOR AI CODE-WRITING TOOL

Cognition Labs, which is transitioning from crypto to AI, is seeking a $2 billion valuation for its code-writing AI tool, Devin. Amidst a trend of soaring valuations in AI startups, Cognition's success reflects the sector's growth and the importance of substantial investments in data and computational resources. Key players like Google and Microsoft continue to advance aggressively in AI with large language models.

See the curriculum

APPLE TO UNVEIL AI-ENABLED SAFARI BROWSER

Safari 18 will introduce UI enhancements, an AI-powered Intelligent Search for content summarization, and a 'Web Eraser' for advanced content blocking.

PHOSPHO

A text analytics platform for LLM apps.

FLOWTESTAI

FlowTestAI stands as the world's first GenAI-powered OpenSource Integrated Development Environment (IDE) specifically designed to craft, visualize, and manage API-first workflows.