TLDR AI 2024-10-16

months to weeks_. Register for the live session.

META'S OPEN AI HARDWARE VISION

Meta showcased open AI hardware designs, including the Catalina rack and the expanded Grand Teton platform, at the OCP Global Summit. Training the Llama 3.1 405B model required 16,000 NVIDIA H100 GPUs, highlighting Meta's scaling infrastructure. Open AI hardware systems are required to continue advancing AI capabilities.

THE NEW YORK TIMES WARNS AI SEARCH ENGINE PERPLEXITY TO STOP USING ITS CONTENT

The New York Times has issued a cease and desist to AI startup Perplexity, accusing it of using its content without permission for AI search operations. Perplexity claims it doesn't scrape content for training but indexes web pages to surface factual content. The company is engaging with publishers and aims to resolve the issue by working with the Times and other media outlets.

DECAGON RAISES $65M SERIES B

Decagon has raised $65 million in Series B funding to enhance its AI customer support agents, which are already used by companies like Duolingo and Eventbrite to efficiently manage customer interactions. Its AI agents automate repetitive tasks, enabling customer support teams to focus on higher-value roles. The funding will bolster Decagon's engineering team and expand its AI solutions into new markets and verticals.

LINEARIZING LLMS

Another great post from Hazy research exploring how to linearize existing language models without sacrificing too much performance

SCENE TEXT EDITING WITH STYLE CONSISTENCY

TextCtrl is a new diffusion-based method that improves scene text editing by maintaining both content accuracy and style preservation.

HUMANOID ROBOTS WITH ENHANCED 3D VISUOMOTOR SKILLS

iDP3 is an improved 3D visuomotor policy that allows humanoid robots to autonomously operate in diverse real-world environments.

TABLED

State-of-the-art system for detecting and extracting tables from PDFs.

ENHANCED IMAGE GENERATION EFFICIENCY

HART is a new visual generation model that creates high-quality 1024x1024 images, challenging the capabilities of diffusion models. It improves image reconstruction and lowers training costs by using a hybrid tokenizer that combines discrete and continuous tokens.

A NEW VISION TRANSFORMER WITH ENHANCED ATTENTION

The Deformable Bi-level Routing Attention (DBRA) module was developed to improve attention mechanisms in vision transformers. DeBiFormer, built on DBRA, optimizes the selection of key-value pairs and improves query interpretability in attention maps.

NEW HIGH QUALITY AI VIDEO GENERATOR PYRAMID FLOW LAUNCHES

Pyramid Flow is a new open-source AI video generator that creates high-quality videos using a pyramidal flow matching technique, optimizing computational efficiency. It competes with proprietary models like Runway Gen-3 Alpha and offers commercial use under the MIT License, though it requires users to host their own version for full application integration. Despite some limitations, its launch highlights the trend toward accessible AI video solutions.

THIS THREE-PERSON ROBOTICS STARTUP IS WORKING WITH DESIGNER YVES BÉHAR TO BRING HUMANOIDS HOME

Kind Humanoid's three-person team is developing a whimsical humanoid robot called Mona. It is designed for home use rather than industrial settings. The team plans to field-test an initial dozen prototypes next year. Focusing on innovation and efficiency over fundraising, Kind's approach contrasts with other AI-driven robotics manufacturers targeting industrial markets.

INTELLECT–1: LAUNCHING THE FIRST DECENTRALIZED TRAINING OF A 10B PARAMETER MODEL

INTELLECT-1 is the first decentralized 10-billion-parameter model. It leverages global contributions for open-source AGI development. OpenDiLoCo scaling has been achieved for training large models across distributed devices, with new advancements in bandwidth efficiency and fault tolerance. The new Prime framework further optimizes decentralized training, increasing compute utilization to 98% for the INTELLECT-1's 10-billion-parameter training run.

TESLA TO OFFER FIRST GLIMPSE OF A ‘ROBOTAXI' THAT DRIVES ITSELF

Tesla has unveiled a prototype self-driving taxi, the Robotaxi, aiming for fully autonomous operations despite skepticism from experts about the near-term feasibility of such technology.

BYTEDANCE LAYS OFF HUNDREDS OF TIKTOK EMPLOYEES IN SHIFT TO AI CONTENT MODERATION

TikTok is shifting towards AI for content moderation, leading to layoffs in Malaysia affecting under 500 employees.

MICROSOFT ARTIFICIAL INTELLIGENCE VP BUBECK TO JOIN OPENAI

Sebastien Bubeck, a Microsoft AI VP focused on small language models, is leaving to join OpenAI.