The Daily Index — Friday, March 8, 2024 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

ANSWER AI’S NEW OPEN SOURCE FINE-TUNING TOOL

Answer AI has released a new FSDP/QLoRA training tool that makes it possible to train 70B parameter models on consumer GPUs. It has open sourced the code and made it easy to run locally or on runpod.

answer.ai · 6 min

TLDR AI

COHERE X ACCENTURE

Cohere and Accenture are collaborating to bring cohere embedding technology to more than 9,000 enterprise clients.

txt.cohere.com · 4 min

TLDR AI

TINYBENCHMARKS: EVALUATING LLMS WITH FEWER EXAMPLES

Evaluating language models is typically done with hand-curated benchmarks. Some of these benchmarks are quite large, with some at over 14k examples, which leads to high expense and noise in evaluation. This work shows that you can reliably evaluate language model performance with as few as 100 examples from popular benchmarks.

arxiv.org · 26 min

TLDR AI

DEEP DIVE: TRAINING MODELS AT SCALE

A great tutorial on the different types of parallelism for training large models at scale.

uvadlc-notebooks.readthedocs.io · 45 min

TLDR AI

TEACHING ROBOTS TO IMITATE

DP3 introduces a cutting-edge approach to imitation learning, combining 3D visual data and diffusion policies to teach robots complex skills efficiently.

3d-diffusion-policy.github.io · 5 min

TLDR AI

NOUS RESEARCH GENSTRUCT MODEL (HUGGINGFACE HUB)

Genstruct is a model that can be used to generate instructions from natural language text. This can then be used to train downstream models for specific useful tasks.

huggingface.co

TLDR AI

BENCHMARKING MULTIHEADED ATTENTION IMPLEMENTATIONS (JUPYTER NOTEBOOK)

There is an almost 10x difference in speed between different implementations of the popular multi-headed attention module used in modern LLMs. This notebook shows a few and benchmarks their performance.

github.com

TLDR AI

AI IS LIKE WATER: NECESSARY, UBIQUITOUS, AND SO SIMILAR

Technology alone is no longer enough to provide a competitive advantage for GenAI companies. This makes GenAI and bottled water similar, as the underlying product is essentially the same. The key differentiators must come from factors such as user experience, distribution, perceived value to customers, branding, and marketing.

nfx.com · 5 min

TLDR AI

SORA, GROQ, AND VIRTUAL REALITY

A few years ago, the concept of the metaverse seemed like it was just fiction from Ernest Cline's book, and Facebook's metaverse push seemed ill-fated. Today, things feel different. Sora generates complex video scenarios and Groq's deterministic chips reduce machine-learning algorithms for faster processing. Together, the convergence of these advancements pushes us closer to achieving real-time video simulation and true virtual reality.

stratechery.com · 6 min

TLDR AI

MICROSOFT INTRODUCES COPILOT AI CHATBOT FOR FINANCE WORKERS IN EXCEL AND OUTLOOK

Microsoft has unveiled a new Copilot chatbot tailored for finance tasks, with a public preview to come before pricing details are announced. The AI can conduct variance analysis, reconcile data in Excel, and expedite Outlook collections, integrating with SAP and Dynamics 365. The tool aims to reduce time spent on manual tasks for finance teams, potentially transforming financial planning and analysis efficiency.

cnbc.com · 2 min

TLDR AI

MICROSOFT’S MISTRAL DEAL BEEFS UP AZURE WITHOUT SPURNING OPENAI

Microsoft's €15 million investment in French AI firm Mistral while continuing its strong partnership with OpenAI illustrates its strategy to diversify and bolster Azure's AI offerings and gain a foothold in the European market ahead of the EU's AI Act. Azure aims to become a model garden, offering a variety of AI models to attract developers and compete with other cloud services. The Mistral deal also positions Microsoft strategically within European AI regulatory frameworks.

theverge.com · 3 min

TLDR AI

US REGULATORS INVESTIGATE WHETHER OPENAI INVESTORS WERE MISLED, SAY REPORTS

The SEC is investigating OpenAI, focusing on CEO Sam Altman's internal communications after accusations that he misled investors. This inquiry coincides with global attention on OpenAI's ChatGPT and scrutinizes the competitive impact of AI investments by OpenAI and tech giants in the sector.

theguardian.com · 2 min