TLDR AI

TLDR AI 2024-07-17

6 sections17 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

TO GET YOUR DATA OFF THE WEB

The bad news is that threat actors are already using AI to collect user information for robocalls, imposter calls, and other types of fraud [4]. Real data + convincing voice impersonation can trip up almost anyone, and deep fakes are only getting better.

links.tldrnewsletter.comSponsor

02HEADLINES & LAUNCHES

ANDREJ KARPATHY'S NEW COMPANY

Eureka Labs is a new education-focused AI company designed to change how we learn new things.

eurekalabs.ai4 min read

WHISTLEBLOWERS ACCUSE OPENAI OF ‘ILLEGALLY RESTRICTIVE' NDAS

Whistleblowers have accused OpenAI of placing illegal restrictions on employee communication with government regulators, according to a letter obtained by The Washington Post, which urges the SEC to investigate OpenAI's severance, non-disparagement, and non-disclosure agreements for violating employees' rights to whistleblower incentives and compensation.

techcrunch.com2 min read

APPLE, NVIDIA, ANTHROPIC USED THOUSANDS OF SWIPED YOUTUBE VIDEOS TO TRAIN AI

Several major AI companies, including Anthropic, Nvidia, Apple, and Salesforce, used subtitles from 173,536 YouTube videos across 48,000 channels to train AI models, despite YouTube's rules against unauthorized data harvesting. This has sparked backlash from content creators, who argue that their work has been exploited without consent or compensation, raising concerns about AI's impact on the creative industry and the ethics of using such training data.

proofnews.org10 min read

03RESEARCH & INNOVATION

SCIENTIFIC CODING BENCHMARK

HumanEval has long been the goal for coding models. It has essentially been solved. This benchmark is the next evolution for challenging science programming problems.

scicode-bench.github.io18 min read

MATHSTRAL

Mistral's newest math model performs well on various benchmarks.

mistral.ai4 min read

CODESTRAL MAMBA

Mistral has trained a Mamba 2 code model with extreme performance in long contexts and 75% on HumanEval.

mistral.ai6 min read

04ENGINEERING & RESOURCES

EXO

Run your own AI cluster at home on everyday devices.

github.comGitHub repository

ENHANCING SAFETY IN LLMS

Decoupled Refusal Training (DeRTa) is a new approach that improves safety tuning in large language models by addressing refusal position bias.

github.comGitHub repository

RGB TO INFRARED IMAGES

Researchers have developed a Physics-Informed Diffusion (PID) model to improve the translation of RGB images to infrared images by incorporating physical laws into the process.

github.comGitHub repository

05MISCELLANEOUS

WHAT HAPPENED TO BERT?

Great post by Yi Tay of Reka and Google on encoders, prefixlm, denoising objectives, and more modern tricks for language modeling.

yitay.net27 min read

SMOLLLM

A great suite of small language models from Hugging Face that outperform many larger models. The key comes in the careful curation of the dataset.

huggingface.co8 min read

REDIS ANNOUNCES BENCHMARK RESULTS FOR VECTOR DATABASES

Redis has unveiled new data on the top vector databases comparing latency and throughput using the industry-standard Qdrant framework. Key findings include Redis outperforming competitors by 62% for low complexity datasets and by 21% for high-dimensional datasets, achieving significantly higher queries per second and lower latency than Qdrant, Milvus, and Weaviate.

redis.io10 min read