TLDR AI 2023-10-12

BIG TECH STRUGGLES TO TURN AI HYPE INTO PROFITS

Tech giants are investing in costly generative AI tools, leading to pricier software upgrades. Firms are exploring ways to balance innovation with profitability while anticipating future cost reductions.

CLEANLAB RAISES $30M TO HELP BUILD TRUSTWORTHY LLMS

Starting as an open sourced package at MIT, CleanLab has now grown into an enterprise-grade no-code tool for curating high quality data for industry ML pipelines.

DEEP DIVE INTO MULTIMODAL FRONTIER MODELS

An excellent dive into the current research activity around multimodal language models.

PAPER FOR MISTRAL 7B MODEL

The Mistral 7B model was released via a tweet. It beats many models twice its size. This paper explores some of the technical contributions and details. No discussion of the pre-training dataset, but good insights into the architecture.

IMPROVING MEMORY IN CONTINUAL TEXT CLASSIFICATION

This study explores the challenges faced in "continual learning", where a model tries to keep learning new things without forgetting old ones, especially in categorizing texts. It introduces a new method called InfoCL, which uses special techniques to help the model remember better and reduce mistakes.

MAKING AI-GENERATED SENTENCES SOUND NATURAL

Researchers found that the sequence in which ideas or 'concepts' are presented to models that generate sentences affects how good the sentences turn out to be. Among various programs tested, BART-large did the best job when given ideas in a certain order, but surprisingly, bigger isn't always better.

OPEN LLMETRY

OpenLLMetry is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application.

Researchers have developed a new technique that combines sound information and language data to correct mistakes in automatic speech recognition systems.

CHATGPT HISTORY EXPORT TO MD

A CASE FOR GPT-4’S CAPACITY TO REASON

Although GPT-4 lacks consciousness and long-term memory, there is good evidence that it is able to reason and comprehend concepts.

UNIVERSAL, INTERACTIVE, REAL WORLD SIMULATOR

What if your simulator was generative AI? It would work to zero shot transfer robotic policies! This work from DeepMind and colleagues tackles the challenge that RL usually can't generalize past the training environment. If we just make everything the training environment then there is no need for extrapolating.

$500 MILLION INVESTMENT IN AI STARTUP ANTHROPIC

Prosecutors want to prevent former FTX cofounder Sam Bankman-Fried’s attorneys from mentioning his $500M investment in AI startup Anthropic during trial, deeming it irrelevant. Meanwhile, Anthropic, seen as a competitor to OpenAI, is seeking funding that could propel its valuation to $20B-$30B, after recently securing a $1.25B commitment from Amazon.

GOOGLE INSIDERS ARE SLAMMING BARD FOR NOT BEING WORTH IT

GROWTH IS SLOWING