The Daily Index — Thursday, December 5, 2024

GENERAL

TLDR AI

version here...

Summary unavailable

app.bland.ai

TLDR AI

META'S NUCLEAR ENERGY PLANS

Meta announced plans to collaborate with nuclear energy developers through a new request for proposals. The initiative aims to add 1-4 gigawatts of nuclear capacity in the U.S. to support Meta's AI innovation and sustainability efforts.

sustainability.atmeta.com · 4 min

TLDR AI

AWS REINVENT TOP ANNOUNCEMENTS

AWS announced various additions and tools including bringing prompt routing and caching to its Bedrock LLM service at AWS re:Invent 2024.

aws.amazon.com · 4 min

TLDR AI

GENIE 2: A LARGE-SCALE FOUNDATION WORLD MODEL

Genie 2 is a large scale latent diffusion model for world generation. It works with character control as input and is also classifier free. The outputs are stunning and maintain control and consistency over time.

deepmind.google · 9 min

TLDR AI

MOTION PROMPTING

Motion Prompting is a method that trains a video generation model with novel input types. Instead of just text or an image, it uses text, first image frame, and a tracking field of pixels. This then allows for novel control at inference time where it can provide a new pixel field (e.g., for an object moving in a new direction) and generate a video based on that. The method is extremely compelling, but not open sourced.

motion-prompting.github.io · 6 min

TLDR AI

DYNAMIC 4-BIT QUANTIZATION

The Unsloth team aims to shrink a 20GB language model into 5GB without sacrificing accuracy. There are many algorithms that attempt this, but there are a number of challenges around outliers and compressibility. Llama is a famously hard model to quantize. The method selectively avoids quantizing certain parameters, which greatly improves overall accuracy.

unsloth.ai · 18 min

TLDR AI

OPTIMIZING AI INFERENCE AT CHARACTER AI

Character AI has a strong inference pipeline. In this post, the team walks through their int8 quantization and flash attention 3 implementation. It's a good read for folks interested in serving large language models at scale.

research.character.ai · 18 min

TLDR AI

CERTAIN NAMES MAKE CHATGPT GRIND TO A HALT, AND WE KNOW WHY

OpenAI's ChatGPT employs hard-coded filters to prevent the AI from generating false statements about specific individuals, leading to broken conversations when these names are mentioned. This approach stems from past incidents like defamation lawsuits against OpenAI, prompting the company to restrict outputs related to contentious names. The hard-coded filters can pose challenges as they limit ChatGPT's functionality and leave the system vulnerable to adversarial attacks.

arstechnica.com · 5 min

TLDR AI

FINETUNING LLM JUDGES FOR EVALUATION

Evaluating LLMs has become challenging due to their complex and open-ended outputs. Traditional evaluation relies on human judgment, which is detailed but inefficient. Thus, automatic metrics and model-based evaluations like LLM-as-a-Judge are crucial for scalable assessment. Innovations such as specialized fine tuned judges (e.g., Prometheus) and synthetic data generation are enhancing LLM evaluation's precision and adaptability across diverse tasks and domains.

cameronrwolfe.substack.com · 52 min

TLDR AI

FLOW

Flow is a lightweight engine for creating flexible AI workflows using dynamic task scheduling and concurrent execution.

github.com · 2 min

TLDR AI

THE GEN AI BRIDGE TO THE FUTURE

Generative AI is set to revolutionize wearable technology by creating on-demand UI interfaces that adapt to user needs and context.

stratechery.com · 12 min

TLDR AI

WORLD LABS' AI CAN GENERATE INTERACTIVE 3D SCENES FROM A SINGLE PHOTO

World Labs, founded by AI expert Fei-Fei Li, has introduced an AI system capable of generating interactive 3D scenes from a single image.

techcrunch.com · 3 min