TLDR AI

TLDR AI 2024-03-11

6 sections23 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

INTELLIGENCE

Join technical leaders from Nylas and AE Studio [4] for an open and candid discussion on AI and its impact on the future of software development. In this live session [4], you’ll hear real-world case studies [4] on using AI to optimize developer toolkits and workflows.

info.nylas.comSponsor

02HEADLINES & LAUNCHES

OPENAI ANNOUNCES NEW MEMBERS TO BOARD OF DIRECTORS

OpenAI announced the addition of three new members to its Board of Directors, Dr. Sue Desmond-Hellmann, Nicole Seligman, and Fidji Simo, along with the return of CEO Sam Altman to the board.

openai.com2 min read

03RESEARCH & INNOVATION

YI: OPEN FOUNDATION MODELS BY 01.AI

The Yi models have long been among the most powerful open language models. The team has released a paper that contains substantial insights into their data collection and training processes.

arxiv.org81 min read

TOXICITY IN LLMS

This project takes on the challenge of reducing harmful content in AI across multiple languages by using translation to improve safety measures where direct data is lacking.

arxiv.org22 min read

IMPROVED PROMPT OPTIMIZATION IN LLMS

This paper introduces metaheuristics, a diverse set of over 100 discrete optimization methods, as a powerful tool for improving prompt learning in large language models.

arxiv.org18 min read

04ENGINEERING & RESOURCES

AXOLOTL INCLUDES QLORA AND FSDP

Last week, a breakthrough was made in training large models on small GPUs. This config shows how to use these technologies to train Mixtral on consumer hardware.

github.comGitHub repository

DEEPSPEED FP6 MODELS

The powerful DeepSpeed training library from Microsoft has an update that allows models to use 6 bits per parameter. This can speed up inference well over 2x.

github.com18 min read

MULTI-VIEW IMAGE GENERATION

ViewFusion is a new algorithm designed to improve how diffusion models generate images from new perspectives, ensuring that the images remain consistent across different views.

wi-sc.github.io3 min read

05MISCELLANEOUS

YOU CAN NOW TRAIN A 70B LANGUAGE MODEL AT HOME

Answer.AI has released an open-source system capable of training 70b large language models on regular desktop computers with standard gaming GPUs to make advanced AI model training accessible to a wider community.

answer.ai8 min read

WINNING STRATEGIES FOR APPLIED AI COMPANIES

We are currently experiencing the third wave of AI. The first wave was research-driven AI. This was followed by the development of ML infrastructure. We are now in the era of applied AI. Applied AI refers to SaaS companies that are utilizing AI to significantly enhance their products. This article delves into more than 70 applied AI companies that have raised over $7 million in VC funding, highlighting how they are growing and why.

medium.com8 min read

AI STARTUPS REQUIRE NEW STRATEGIES

Startups in the AI era face unique challenges as incumbents leverage their extensive data, established customer bases, and ability to attract top talent, diminishing the traditional startup advantages of agility and innovation.

longform.asmartbear.com9 min read