TLDR Index
TLDR AI

TLDR AI 2024-11-29

6 sections17 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

SELLING THEM LEGALLY

This holiday season, you deserve peace of mind—especially when it comes to your personal data.

get.incogni.ioSponsor

02HEADLINES & LAUNCHES

AI2 RELEASES NEW LANGUAGE MODELS COMPETITIVE WITH META'S LLAMA

Ai2 has released OLMo 2, an open-source language model series with models containing 7 and 13 billion parameters. OLMo 2 is developed with publicly accessible training data and code. Aiming to boost open-source AI innovation, Ai2 claims these models outperform similar open models like Meta's Llama 3.1. The models are available under the Apache 2.0 license for commercial use.

techcrunch.com3 min read

XAI COULD SOON HAVE ITS OWN APP

Elon Musk's xAI plans to launch a standalone app for its Grok chatbot by December, competing directly with OpenAI's ChatGPT. Grok is currently accessible through X for subscribers only. This move positions xAI to more directly challenge established chatbot apps from OpenAI, Google, and Anthropic.

theverge.com1 min read

03RESEARCH & INNOVATION

THUNDERKITTENS FOR APPLE SILICON

Hazy Research has been critical in improving hardware utilization for AI workloads. It has extended its amazing ThunderKittens Kernel writing framework to work on Apple Silicon.

hazyresearch.stanford.edu15 min read

04ENGINEERING & RESOURCES

OPEN INSTRUCT

The Allen AI Institute has released extremely useful post training code for instruction tuning.

github.comGitHub repository

STAR ATTENTION

Up to 11x speed improvement for long context token processing and generation. It is slightly better than ring attention, but still worse than full attention.

github.comGitHub repository

FINE-GRAINED IMAGE QUALITY ASSESSMENT

Grounding-IQA is a new approach to image quality assessment (IQA) that integrates precise location-based grounding and multimodal descriptions.

zhengchen1999.github.io2 min read

05MISCELLANEOUS

IT'S SURPRISINGLY EASY TO JAILBREAK LLM-DRIVEN ROBOTS

RoboPAIR is an algorithm that successfully jailbreaks robots powered by LLMs, bypassing all safety guardrails. Experiments showed a 100% success rate in hacking systems like Go2, a self-driving simulator, and robot dogs. These findings reveal significant security vulnerabilities, stressing the need for better defenses against LLM-based robot hacking.

spectrum.ieee.org6 min read

WORLD'S MOST FLEXIBLE SOUND MACHINE DEBUTS

Fugatto, a new generative AI model, allows users to control audio creation and transformation using text prompts. It can generate music, modify voices, and create unique sounds, showcasing capabilities through tasks like music production and video game development. Developed by NVIDIA researchers, Fugatto uses 2.5 billion parameters and was trained on a vast dataset to handle multilingual audio tasks and unsupervised learning.

blogs.nvidia.com6 min read

THE NEW AI SCALING LAW SHELL GAME

Recent shifts in AI scaling laws reveal limitations in predictability and effectiveness, with new models not meeting earlier expectations. Microsoft CEO Satya Nadella highlights "inference time compute" as a potential area of focus, but concerns about cost and reliability persist. Innovation beyond scaling is needed. LLMs should be part of a broader AI strategy.

garymarcus.substack.com4 min read