TLDR AI

TLDR AI 2023-11-03

5 sections15 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

META’S AI RESEARCH HEAD WANTS OPEN SOURCE LICENSING TO CHANGE

Meta's Llama 2, touted as open-source, faces scrutiny due to its limited license not meeting all Open Source Initiative requirements. Despite this, Meta's VP for AI research, Joelle Pineau, emphasizes the balance between information-sharing and business costs, aiming for collaborative innovation akin to its previous open-source project PyTorch.

theverge.com4 min read

UK INVESTS $273M IN AI SUPERCOMPUTER

The UK government is investing $273 million in an AI supercomputer dubbed Isambard-AI, which will be constructed by the University of Bristol, showcasing its aspiration to excel in AI technology.

cnbc.com1 min read

02RESEARCH & INNOVATION

LONG(ER) CONTEXT MISTRAL MODEL

Amazon enters the open source LLM game with a RoPE fine-tuned Mistral 7B that scales up to 32k tokens in context.

huggingface.co3 min read

LONG(EST) CONTEXT MISTRAL MODEL

Nous research has used their Yarn method to fine-tune Mistral 7B to operate on contexts up to 128k. It shows minimal degradation on short sequence lengths and vastly improved performance on long documents.

huggingface.co3 min read

TUNING LANGUAGE MODELS FOR EMPATHY

Researchers have developed a way to improve empathy in large language models used for psychological counseling by creating a dataset for empathetic conversation training.

arxiv.org8 min read

03ENGINEERING & RESOURCES

CODE RELEASED FOR MOE PEFT

Cohere’s research arm For AI developed parameter efficient fine-tuning for Mixture-of-Experts models. It recently released the code for the community to build on.

github.comGitHub repository

USING CHATGPT FOR IMAGE CLASSIFICATION

This study shows that image classification can be improved by using large language models to organize classes into hierarchies, addressing biases in pretrained models like CLIP that confuse similar categories.

arxiv.org14 min read

04MISCELLANEOUS

SIFTING THROUGH THE NOISE: HOW AI WILL IMPACT INFORMATION OVERLOAD

No doubt, you consume a lot of content on a weekly basis. Articles, blog posts, tweets, this newsletter. With AI, the rise of user-generated content is going to increase exponentially. The systems you build to defend your attention will be more important than ever.

maried.substack.com5 min read

AI’S ROLE IN RUNNING SOFTWARE COMPANIES

From helping you to write code, checking the quality of that code, and adding repeatability to your content generation, AI is going to impact how we think about leverage in the daily operations of our software companies. This article explores the common areas you should be thinking about adding AI to your operations.

davidcummings.org2 min read

TALK LLAMA

Talk with a LLaMA AI in terminal.

github.comGitHub repository