The Daily Index — Monday, August 26, 2024 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

WHAT'S REALLY GOING ON IN MACHINE LEARNING

Stephen Wolfram, the creator of Wolfram|Alpha, wrote a great exploration about different phenomena going on in machine learning models. He discovered a set of dynamics about the non-linearities in simple neural networks.

writings.stephenwolfram.com · 28 min

TLDR AI

AGI SAFETY AND ALIGNMENT AT GOOGLE DEEPMIND

Google DeepMind's AGI Safety & Alignment team shared a detailed update on their work focused on existential risk from AI. Key areas include amplified oversight, frontier safety, and mechanistic interpretability, with ongoing efforts to refine their approach to technical AGI safety. They highlighted recent achievements, collaborations, and plans to address emerging challenges.

alignmentforum.org · 20 min

TLDR AI

ENERGY-EFFICIENT AUTONOMOUS DRIVING WITH SPIKING NEURAL NETWORKS

Spiking Autonomous Driving (SAD) is the first unified Spiking Neural Network (SNN) aimed at addressing the energy challenges of autonomous driving.

arxiv.org · 19 min

TLDR AI

EFFICIENT LANGUAGE MODEL TRAINING

Inheritune is a streamlined method for developing smaller base language models from larger ones by inheriting a few transformer blocks and training on a tiny fraction (0.1%) of the original data. This approach enabled the creation of a 1.5B parameter model using only an A6000 GPU in less than half a day, achieving results that compete well against larger models trained on significantly more data.

arxiv.org · 19 min

TLDR AI

TIME SERIES REPRESENTATION LEARNING WITH DIFFUSION MODELS

Time Series Diffusion Embedding (TSDE) is the first diffusion-based approach for time series representation learning. TSDE segments time series data and uses dual-orthogonal Transformer encoders with a crossover mechanism to generate informative embeddings.

arxiv.org · 16 min

TLDR AI

TEACHING CHAT MODELS TO SOLVE CHESS

Traditional base language models are quite good at playing chess, averaging around 1800 elo. However, chat models tend to struggle with a precipitous drop in performance. This post explores how to tune chat models like GPT-4o to play chess through a combination of prompting and fine-tuning.

raw.sh · 28 min

TLDR AI

DATA EXFILTRATION FROM SLACK AI VIA INDIRECT PROMPT INJECTION

A vulnerability in Slack AI was discovered where attackers can exfiltrate data from private channels they aren't members of via indirect prompt injection. It allows attackers to use public channel messages to manipulate the LLM into divulging private information, such as API keys, in query responses. This issue, alongside a phishing attack vector, persists even after Slack AI's August 14th update incorporating channel and DM files, significantly expanding the risk surface area for such exploits.

promptarmor.substack.com · 7 min

TLDR AI

GENERALIZED SEGMENT ANYTHING MODEL

Generalized SAM (GSAM) is a new method for fine-tuning the Segment Anything Model (SAM) with variable-size images more efficiently.

arxiv.org · 24 min

TLDR AI

NEW SIGLIP MODEL (HUGGING FACE HUB)

Google has released a new SigLIP model that uses a shape optimized vision transformer model architecture.

huggingface.co

TLDR AI

3D OCCUPANCY ESTIMATION

GaussianOcc is a method for fully self-supervised and efficient 3D occupancy estimation using surround views.

ganwanshui.github.io · 3 min

TLDR AI

BRINGING LLAMA 3 TO LIFE

Meta has introduced Llama 3.1, an advanced open-source LLM that brings new capabilities like synthetic data generation and model distillation.

engineering.fb.com · 1 min