The Daily Index — Friday, September 15, 2023 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

STORAGE

MLPerf has released results from two benchmark suites: MLPerf Inference v3.1, which showcases record participation and performance gains, and MLPerf Storage v0.5, which assesses storage system performance for ML training workloads. The Inference benchmark suite introduced a large language model and updated recommender tests, reflecting emerging AI trends.

mlcommons.org · 5 min

TLDR AI

ALIGN A LANGUAGE MODEL WITHOUT TRAINING

Alignment helps make language models more helpful and harmless. It can sometimes hurt performance, but in general is a positive. Alignment is expensive and requires substantial alignment data. However, if you allow the model to rewind during generation after evaluating its own output, it can improve alignment performance on the frozen model by up to 81%.

arxiv.org · 25 min

TLDR AI

PUSHING MIXTURE OF EXPERTS TO THE LIMIT WITH PARAMETER EFFICIENCY

Mixture of experts (MoEs) is a cool way to increase the capacity of a model without increasing per token runtime. However, they're still tricky to run quickly and fine-tune. Researchers find that if you modify dense model parameters efficiently fine tuning to work with MoEs you can dramatically reduce tuning costs without hurting performance too much.

arxiv.org · 28 min

TLDR AI

MAKING BETTER RECOMMENDATIONS

Researchers have developed a new model called HAMUR to improve how models make suggestions or "recommendations" across multiple subjects or domains, like music, books, or movies. Unlike older methods that mix up information between these domains, HAMUR uses a special technique to keep data separate and more flexible.

arxiv.org · 18 min

TLDR AI

A NEW DATASET TO SPOT FAKE CELEBRITY IMAGES

DeepFakeFace (DFF) is a collection of fake celebrity photos made with advanced technology designed to help us get better at telling real pictures from fake ones.

arxiv.org · 9 min

TLDR AI

NEW STATE OF THE ART TEXT TO SPEECH MODEL

Coqui has released weights for its xtts model, which can clone voice parameters and synthesize in different languages.

huggingface.co · 2 min

TLDR AI

THE BUMPY ROAD TOWARD GLOBAL AI GOVERNANCE

Researchers suggested a global AI ethics agreement a few years ago, emphasizing its feasibility despite philosophical differences. As the U.S.-China AI competition grows, challenges like misperceptions and language barriers persist in achieving global AI regulation.

noemamag.com · 10 min

TLDR AI

Untitled entry

Scientists have developed RETFound, an AI tool capable of diagnosing and predicting the risk of developing multiple health conditions, from ocular diseases to heart failure to Parkinson’s disease, from just retinal images.

nature.com · 2 min