TLDR AI

TLDR AI 2024-08-16

6 sections19 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

DAY 1

Selling AI to enterprise means getting serious about security, user identity, and access management — involving features like single sign-on, SCIM, and RBAC/FGA.

workos.comSponsor

02HEADLINES & LAUNCHES

NOUSE HERMES 3

Nous Research has released its flagship model. Trained on top of Llama 3, the model has strong performance and a great personality like many of the company's original models.

nousresearch.com5 min read

CALIFORNIA AI BILL SB 1047 AIMS TO PREVENT AI DISASTERS, BUT SILICON VALLEY WARNS IT WILL CAUSE ONE

California's SB 1047, designed to prevent "critical harms" from large AI models, faces pushback from Silicon Valley, with stakeholders divided over its potential impact on innovation. Major industry figures and companies debate the bill's merits and consequences on AI development and safety. The bill, which requires AI model safety protocols and third-party audits, with enforcement and hefty fines outlined for non-compliance, is heading to a final Senate vote.

links.tldrnewsletter.com8 min read

SOFTBANK'S INTEL AI PROCESSOR PLANS IN DOUBT AS INSIDERS SAY IT IS NOW CONSIDERING A TSMC PARTNERSHIP

Intel failed to produce AI processors for SoftBank's Project Izanagi, leading SoftBank to explore a partnership with TSMC. Despite setbacks, SoftBank remains committed to challenging major AI players with its own hardware and data center ecosystem, potentially backed by significant investment from global partners. The move could strain SoftBank's relationship with Arm clients as it risks direct competition.

tomshardware.com3 min read

03RESEARCH & INNOVATION

ANCHORED PREFERENCE OPTIMIZATION

Tuning models to align with human preferences usually requires some post training. However, when training these models it is not clear why one example is better than another. APO is a way for models to degrade existing examples and then use that degraded example to anchor the difference in preference.

arxiv.org25 min read

MUTUAL REASONING MAKES SMALL MODELS SMARTER

Tree search is an extremely active area of research for inference time computation for language models. This paper from Microsoft shows a particularly compelling case that enables small models to improve dramatically on mathematics problems.

arxiv.org34 min read

SEMANTIC SEGMENTATION WITH METASEG

MetaSeg is a powerful semantic segmentation network built on the MetaFormer architecture that enhances both the backbone and decoder of the network.

arxiv.org14 min read

04ENGINEERING & RESOURCES

Sponsored

GITHUB REPO ⭐ DATACHAIN: UNSTRUCTURED DATA MANAGEMENT FOR AI PROJECTS, REIMAGINED

Iterative's new open-source tool lets you simplify AI projects and scale unstructured data management. With DataChain, you can source, curate, and version cloud data at scale [12]; easily integrate metadata from various formats; parallelize local and API-based AI model inferences for 3x-10x speedup [12]; and store AI model outputs as Python data objects.

github.comSponsor

LONG CONTEXT RAG

This post explores how long context models perform on various RAG tasks. Improving the number of examples can help. These models often fail in strange but predictable ways.

databricks.com21 min read

UNIVERSAL WAVEFORM GENERATION

PeriodWave is a new model for universal waveform generation that excels in capturing the natural periodic features of high-resolution waveform signals.

periodwave.github.io3 min read

SECURITY RISKS IN MODEL MERGING

As Model Merging (MM) becomes a popular method for combining fine-tuned models without additional training, new security risks emerge. This paper introduces BadMerging, the first backdoor attack specifically targeting MM.

github.comGitHub repository

05MISCELLANEOUS

A COMPREHENSIVE SURVEY ON MODEL MERGING TECHNIQUES

This survey provides an in-depth review of model merging techniques, an increasingly popular method in machine learning that doesn't require raw training data or expensive computation.

arxiv.org41 min read

BRANDS SHOULD AVOID “AI”

A recent study found that labeling products as "AI-powered" can decrease consumer intent to purchase due to trust issues and fears of the unknown. The research suggests that both cognitive and emotional trust are factors, with people wary of AI's inner workings and risks, especially regarding personal data privacy. Companies are advised to focus on clear messaging about AI benefits rather than using "AI" as a buzzword.

cnn.com3 min read

TRANSFORMER EXPLAINER

Beautiful visualization of the inner workings of a Transformer.

poloclub.github.io4 min read