TLDR AI

TLDR AI 2024-06-26

6 sections18 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

NVIDIA

With Vultr, unlock immediate access to the latest NVIDIA GPU's for AI machine learning. Receive the flexibility you need with Vultr's on-demand virtual machines [4] or opt for the power of large-scale dedicated clusters. With 32 data center locations across six continents, Vultr delivers seamless, low-latency access to cloud infrastructure.

links.tldrnewsletter.comSponsor

02HEADLINES & LAUNCHES

ETCHED RAISES $120M SERIES A TO BUILD AI CHIPS FOR TRANSFORMERS

Etched has announced a $120M round led by Primary Venture Partners and Positive Sum Ventures, as well as angel investors including Peter Thiel, Stanley Druckenmiller, and David Siegel. It is working directly with TSMC's Emerging Business Group to produce chips on their state-of-the-art, 4 nanometer node. Its chips can achieve 500K tokens/second. One 8xSohu can replace 160 H100s.

techcrunch.com4 min read

STABILITY AI NEW FUNDING

In addition to a new CEO, Stability AI was able to secure a “significant infusion of capital” from existing and new investors.

stability.ai2 min read

APPLE INTELLIGENCE AND AI MAXIMALISM

Apple is segmenting its AI approach, differentiating between 'context' and 'world' models, with the latter, such as ChatGPT, being used for open-ended queries but without personal context. OpenAI's position is not highly defensible, given the lack of moats in large language models (LLMs) and the rise of competing models. Apple's strategy suggests a commoditization trend for LLMs that leverages on-device capabilities and private cloud to provide AI features while viewing services like ChatGPT as interchangeable components.

ben-evans.com6 min read

03RESEARCH & INNOVATION

RAG FINE-TUNING

Together AI and Morph Labs have put together a great blog post on tuning models for retrieval augmented generation. They showcase some uses of synthetic data as well.

together.ai12 min read

IMBUE TRAINS 70B THAT MATCHES GPT-4

Imbue has trained and released an extremely powerful 70B language model. It uses Imbue's custom optimizer and some great data filtering techniques. The model was trained with zero loss spikes.

imbue.com18 min read

EVALALIGN FOR TEXT-TO-IMAGE EVALUATION

EvalAlign is a new metric designed to improve the evaluation of text-to-image generative models. Unlike existing metrics, EvalAlign offers fine-grained accuracy and stability. It focuses on image faithfulness and text-image alignment.

arxiv.org14 min read

04ENGINEERING & RESOURCES

Sponsored

EASILY DEPLOY ML MODELS AT THE EDGE

Bring inference closer to your users with Gcore [12]. Use a single endpoint that's automatically deployed where you need it and never worry about managing GPUs and containers [12]. Reduce latency, enable ultra-fast responses for your AI-powered apps, and double the value

gcore.comSponsor

FINE-TUNE FLORENCE 2

Microsoft's new many-to-many vision model can be tuned for specific downstream tasks. It isn't quite as powerful as PaliGemma, but is easy to run in PyTorch.

huggingface.co14 min read

2:4 SPARSE TRAINING IN PYTORCH

The PyTorch team has written custom kernels to make use of sparse cores, which are usually reserved for inference only.

pytorch.org16 min read

CONTROL VIDEO GENERATION TRAJECTORIES WITHOUT TRAINING

FreeTraj is a tuning-free method to control the motion trajectories in video generation using diffusion models. It modifies noise sampling and attention mechanisms to guide the generated content.

haonanqiu.com5 min read

05MISCELLANEOUS

MOLECULAR MODELING WITH TRANSFORMER

GeoMFormer is a new Transformer-based model designed to improve molecular modeling by learning both invariant and equivariant features.

arxiv.org16 min read

HOW TO SOLVE LLM HALLUCINATIONS

Lamini has developed Memory Tuning to reduce hallucinations by 95%, embedding specific data into models more efficiently without compromising general knowledge.

morethanmoore.substack.com7 min read