TLDR AI 2024-05-20

Security is using it to build better defenses. This blog post

shows how AI-powered security enables companies to:

→ Read the full article on the Orca blog

→ See how you can simplify investigations and accelerate remediation

with Orca's built-in generative AI

WHAT HAPPENED TO OPENAI'S LONG-TERM AI RISK TEAM?

OPEN RELEASE OF GROK-1

xAI has released the weights and architecture for Grok-1. Grok-1 is a Mixture-of-Experts model with 314 billion parameters. The released model is a raw base model checkpoint from the Grok-1 pretraining phase, which means that it is not fine-tuned for any specific application. It was trained from scratch by xAI using a custom training stack.

$16K G1 HUMANOID RISES UP TO SMASH NUTS, TWIST, AND TWIRL

Unitree has released the first few details on its G1 Humanoid Agent, a $16,000 robotic helper. The robot is equipped with 3D LiDAR sensors, a depth camera, three-fingered grippers, and a 9,000-mAh battery pack. It can recover from brutal kicks and punches, as seen in the short demo video in the article. At around 35 kg, the robot can fold itself down to 690x450x300-mm proportions for compact carry.

LORA LEARNS LESS AND FORGETS LESS

LoRA is a popular way to fine-tune models to inject style or knowledge. This paper explores the trade off between power and forgetting when using LoRAs. The research finds that LoRAs are able to learn less than full fine tuning, but maintain more of the original “out of distribution” performance.

CHAMELEON EARLY FUSION MULTI-MODAL

Meta has announced a natively multi-modal model called Chameleon that operates on images and text simultaneously like GPT-4o. It outperforms many alternative models. The Meta team has since far surpassed this work on internal models.

GEMINI 1.5 TECHNICAL REPORT (153 PAGE PDF)

Google's most recent family of models has an updated technical report. There is little information about the models or the data used, but there is significant information about the evaluation and safety measures taken, which is an interesting window into large-scale alignment.

MODEL EXPLORER

Google has released a model explorer that makes it easy to inspect the computation graph of your models. It can be useful for debugging and performance engineering.

RUN PALIGEMMA IN REAL TIME

Using GPT-Fast, you can run the most recent Google VLM in real time. This opens up a number of powerful downstream tasks as the model is extremely easy to fine-tune for specific tasks.

EXPERTS

Experts is the easiest way to create and deploy OpenAI's Assistants and link them together as Tools to create a Panel of Experts system with expanded memory and attention to detail.

GOOGLE I/O 2024: EVERYTHING YOU NEED TO KNOW

Google kicked off its I/O developer conference with a two-hour presentation containing a rapid-fire stream of announcements. This article summarizes these announcements into an easy-to-read list. The announcements include Firebase Genkit, an addition to the Firebase platform aimed at making it easier for developers to build AI-powered applications in JavaScript/TypeScript; LearnLM, a family of generative AI models fine-tuned for learning; AI-generated quizzes on YouTube; a new discovery feature for apps in Google Play; scam call detection; Ask Photos, a feature that lets users search across their Google Photos collection using natural language queries; and much more.

GAMMA RAISES $12M SERIES A

Gamma raised $12M from Accel to reimagine presentations using AI. So far, 60M+ Gammas (AI-generated slides) have been created across 18M+ users.

AI AGENT BUILDS GARPLE.COM

Garple is a website that sells short, easy-to-say .com domains that would make good startup names. All the code was written by an AI coding agent.

(almost) any job. Register for the No Code AI Building Webinar

FIRST-EVER AI CODE INTERPRETER FOR R

Julius AI has launched the first-ever AI code interpreter for the programming language R, potentially revolutionizing how academic researchers perform statistical analysis.

TOUCH AI (PRODUCT)

Find ideal business customers using AI and Bayesian models for optimal delivery and conversion rates.

MOONDREAM ON WEBGPU (HUGGING FACE SPACE)

An experiment in running the small MoonDream VLM directly on the web with WebGPU inference.