TLDR AI

TLDR AI 2023-10-31

5 sections16 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

GPT-3.5-TURBO IS 20B PARAMETER

Researchers wrote that gpt-3.5-turbo (the model behind ChatGPT) is a 20B parameter model in a paper by a Microsoft research group that studies diffusion models for code. The original model was said to be 175B parameters, so there could have been retraining or distillation.

arxiv.org2 min read

ANNOUNCING THE OPEN EMPATHIC PROJECT

The group behind Stable Diffusion has launched the Open Empathic project to foster emotion-detecting capabilities in open-source AI systems for more authentic AI-human interactions.

techcrunch.com4 min read

BIDEN RELEASES AI EXECUTIVE ORDER

President Joe Biden signed an executive order outlining eight goals to regulate generative AI, focusing on safety, privacy, equity, consumer protection, innovation, and responsible government use, with agencies like the NIST tasked to develop AI standards and large AI model developers required to share safety test results.

theverge.com2 min read

02RESEARCH & INNOVATION

USING EMBEDDINGS IN COMPUTER VISION

Embeddings are machine-readable lists of numbers that represent some information about a piece of data. They are increasingly obtained by running the data through a neural network and looking at the activations of the model. This post pushes that idea forward with CLIP on a computer vision task and explores how to use dimensionality reduction to reason about the learned embeddings.

blog.roboflow.com12 min read

AMD TRAINING ROUND 2

A post from MosaicML on using AMD GPUs for training large language models.

databricks.com17 min read

03ENGINEERING & RESOURCES

PERSONALIZED IMAGE CLUSTERING

This paper introduces Image Clustering Conditioned on Text Criteria (IC⁠TC), a method that leverages vision-language models to sort images based on user-given text descriptions.

github.comGitHub repository

AZURE OPENAI LOGGER

This project aims to create a simple and easy to deploy solution to add observability to your Azure OpenAI instance. The approach adds an API Management instance as a proxy for your existing Azure OpenAI service, and funnels logs/requests/responses to an Application Insights instance. It also saves a prebuilt query to a workbook for easy access to logs.

github.comGitHub repository

INSANELY FAST WHISPER

Transcribe 300 minutes of audio in less than 10 minutes with OpenAI’s Whisper Large v2.

github.comGitHub repository

04MISCELLANEOUS

APPLE AND AI

Apple is lagging in AI advancements, especially when compared to competitors like Google and Microsoft, and there are doubts among Apple insiders that its AI/ML team can deliver.

daringfireball.net2 min read

AI GODFATHERS PROPOSE FRAMEWORK TO MITIGATE AI RISKS

AI pioneers Yoshua Bengio and Geoffrey Hinton, along with 22 other AI experts, have proposed a policy framework emphasizing AI safety and have recommended that companies and governments allocate a third of their AI R&D budget to safety efforts.

venturebeat.com3 min read