The Daily Index — Tuesday, March 19, 2024 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

APPLE RESEARCHERS ACHIEVE BREAKTHROUGH IN MULTIMODAL AI

Apple researchers have developed methods for training large language models on both text and images, leading to state-of-the-art performance in multimodal AI tasks.

venturebeat.com · 3 min

TLDR AI

STABILITY AI RELEASES STABLE VIDEO 3D

Built on top of Stable Video, Stable Video 3D can generate 3D models from a single image. It outperforms Stable Zero 123 and other methods. Weights are available for research purposes and commercial use with a Stability AI membership.

stability.ai · 6 min

TLDR AI

MECHANICS OF NEXT TOKEN PREDICTION WITH SELF-ATTENTION

Next token prediction is a simple objective that leads to complex behaviors. This work found that a single self attention layer trained with gradient descent broke the problem down into hard retrieval and soft composition, which enabled in-context learning and strong overall performance.

arxiv.org · 40 min

TLDR AI

ENHANCING OBJECT DETECTION WITH VISUAL TRANSFORMERS

YOLOX-ViT introduces a new approach to object detection in underwater robotics by integrating visual transformers and knowledge distillation.

arxiv.org · 11 min

TLDR AI

PRETRAINING THE SAME MODEL WITH 16 DIFFERENT TOKENIZERS

A weird fact of modern language modeling is that we train a tokenizer first before training the model. The second weird fact is that vocab size doesn't seem to matter too much at large scales.

github.com · 7 min

TLDR AI

CAPTAIN'S LOG: THE IRREDUCIBLE WEIRDNESS OF PROMPTING AIS

A new companion website, More Useful Things, offers a trove of free AI and machine learning resources, underlining the quirky and effective ways AI-generated prompts, like imaginative scenarios, can outperform human-crafted ones in tasks such as mathematical problem-solving. The experiment underscores the importance of adding context, few-shot learning, and chain-of-thought techniques for more consistent prompting results. As AI models advance, prompting as a skill may become less critical, with AI improving at inferring user intent, but currently, structured prompting remains an evolving art with significant potential benefits.

bit.ly · 7 min

TLDR AI

AI PROMPT ENGINEERING IS DEAD

Recent studies suggest human prompt engineers may become obsolete as AI and machine learning models increasingly optimize their own prompts. Algorithmically generated prompts can be bizarre yet effective, outperforming human-crafted ones and reducing optimization time dramatically. While automatically tuned prompts show promise, experts believe that the demand for prompt-related jobs will evolve rather than disappear, potentially under new job titles like LLMOps (Large Language Model Operations).

spectrum.ieee.org · 8 min

TLDR AI

months free

Summary unavailable

zendesk.com

TLDR AI

GOOGLE RESEARCHERS UNVEIL AN AI THAT CAN BRING STILL VIDEOS TO LIFE

VLOGGER is an AI created by Google researchers that generates lifelike videos of people speaking and moving from a single photo.

venturebeat.com · 3 min

TLDR AI

MICROSOFT HAS ADDED THE GPT-4 TURBO LLM TO THE FREE VERSION OF COPILOT

Copilot Pro users can still opt for the older model and they also have access to Copilot GPT Builder for creating custom chatbots without programming expertise.

neowin.net · 2 min

TLDR AI

KOREAN RESEARCHERS POWER-SHAME NVIDIA WITH NEW NEURAL AI CHIP

KAIST researchers have developed the C-Transformer, an ultra-low-power AI chip for large language models that boasts significant energy efficiency improvements over Nvidia's A100 GPU.

tomshardware.com · 4 min