TLDR Index
TLDR AI

TLDR AI 2023-12-08

5 sections20 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

META’S PURPLE LLAMA SAFETY PROJECT

Purple Llama, a new project aiming to level the playing field for building safe and responsible generative AI experiences, is launching with permissively licensed tools, evaluations, and models for both research and commercial use. Initial offerings include CyberSecEval for assessing AI system security, the Llama Guard model for detecting and preventing cyberattacks, and tools for insecure code detection and cyber attack compliance testing. This initiative democratizes access to essential resources, empowering developers to create secure and responsible AI experiences.

ai.meta.com6 min read

X BEGINS ROLLING OUT GROK

Grok, a new ChatGPT competitor developed by Elon Musk's AI startup xAI, has been launched on X for Premium Plus subscribers in the U.S.

techcrunch.com4 min read

ENABLING NEXT-GENERATION AI WORKLOADS: ANNOUNCING TPU V5P AND AI HYPERCOMPUTER

Google has announced Cloud TPU v5p, its most powerful, scalable, and flexible AI accelerator yet. TPUs are used for training and serving AI-powered products. Google has also announced AI Hypercomputer from Google Cloud, a supercomputer architecture that uses an integrated system of performance-optimized hardware, open software, leading ML frameworks, and flexible consumption models. AI Hypercomputer employs systems-level co-design to boost efficiency and productivity across AI training, tuning, and serving.

cloud.google.com7 min read

02RESEARCH & INNOVATION

LONG CONTEXT PROMPTING FOR CLAUDE

The recent release of Claude from Anthropic had 200k tokens in context. It seemed to suffer from the “lost in the middle” problem of language models in external evals, meaning it only had 27% retrieval performance on some standard problems. However, if you add the sentence “Assistant: Here is the most relevant sentence in the context” to the prompt the retrieval performance jumps to 98%.

anthropic.com8 min read

03ENGINEERING & RESOURCES

MAMBA CHAT

Mamba is a non-transformer-based model with amazing performance. It has been chat-tuned with SFT and seems to have substantially better out-of-the-box retrieval ability than similarly sized transformers.

github.comGitHub repository

LLAMA IN MLX

Just a day after the MLX framework from Apple was released, folks have already enabled Llama 2 models to run on the new framework.

huggingface.coGitHub repository

MISTRAL MLX EXAMPLE

An example of generating text with Mistral using MLX.

github.comGitHub repository

04MISCELLANEOUS

SINGLE-IMAGE 3D VIEW SYNTHESIS

Free3D is an innovative approach that creates 3D views from just one image, without the need for slow and bulky 3D models.

chuanxiaz.com3 min read

ML SYSTEM DESIGN: 300 CASE STUDIES TO LEARN FROM

This site contains a database of 300 case studies from over 80 companies that share practical machine learning use cases and learnings from designing ML systems. The database can be filtered by industry or ML use case. Tags based on recurring themes are available.

evidentlyai.comTool