The Daily Index — Friday, August 25, 2023 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

HUGGING FACE RAISES $235 MILLION

Hugging Face has raised $235 million in a Series D funding round, with participation from Google, Amazon, Nvidia, Intel, AMD, Qualcomm, IBM, Salesforce, and Sound Ventures. The startup is now valued at $4.5 billion.

techcrunch.com · 3 min

TLDR AI

SECURITY SOLUTIONS

The White House, in collaboration with tech giants like Google and OpenAI, has initiated the "AI Cyber Challenge" to develop AI that can spot and fix software vulnerabilities. The competition is offering $20 million in prizes. Winning teams will be encouraged to open-source their solutions.

engadget.com · 3 min

TLDR AI

LEGAL REASONING BENCHMARK

A pretty large and collaborative effort at constructing a benchmark for measuring language models' ability to reason in a legal framework. Watch out for contamination in already trained models.

hazyresearch.stanford.edu · 12 min

TLDR AI

VIDEO GENERATION BENCHMARK

Storytelling via automatic video generation is an emerging area of research. The tasks of story continuation, story remixing, and others are tough to measure. Hopefully, this great new Google benchmark helps the field make progress.

arxiv.org · 26 min

TLDR AI

A NEW WAY TO TRACK 3D OBJECTS USING LIDAR POINTS

Most computer vision tools have trouble tracking 3D objects using LiDAR points because of distractions or not noticing long-term movements. MTM-Tracker mixes two methods and works in two stages to solve these problems.

arxiv.org · 12 min

TLDR AI

UNIT SCALING FOR LOW PRECISION TRAINING

Graphcore released an excellent Pytorch library that makes training in fp8 super easy and stable. A single model wrapper and torch compile is all you need.

graphcore-research.github.io · 6 min

TLDR AI

DPO ON LLAMA 2

Human feedback is key to improving language model alignment and overall performance. However, the process of training with Proximal Policy Optimization has some challenges. Recent work showed that you can optimize directly against human preference and bypass the reward model. With Text-based Reinforcement Learning, you can do this on state-of-the-art open models.

huggingface.co · 6 min

TLDR AI

TOWARD AGI - WHAT IS MISSING?

An exploration into why the current crop of LLMs are unlikely to lead to AGI and why physics itself will prevent any sudden leaps from where we are now to AGI.

mark-riedl.medium.com · 23 min

TLDR AI

AI ISN’T GOOD ENOUGH

While AI is very good, it’s not yet good enough to provide the automation that the economy needs.

skventures.substack.com · 10 min

TLDR AI

ONE CLICK FINE-TUNE FROM THE COMMAND LINE

A cool tool that automates the new gpt-3.5-turbo tuning processes with local files from disk.

jxnl.github.io · 5 min