TLDR AI

TLDR AI 2023-11-22

5 sections15 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

SAM ALTMAN TO RETURN AS CEO OF OPENAI

OpenAI is welcoming Sam Altman and former President Greg Brockman back following the boardroom coup, a move seen by investors as a win for the firm's mission. This shake-up includes a new board aimed at resetting OpenAI's governance and a planned investigation into the recent turmoil. Both Microsoft and Altman wish to occupy seats in an expanded board.

theverge.com3 min read

MICROSOFT AND NVIDIA ARE MAKING IT EASIER TO RUN AI MODELS ON WINDOWS

Microsoft has announced Windows AI Studio, a hub for developers to access and configure AI models, with tools from Azure AI Studio and Hugging Face and features like model configuration UI and performance testing templates. Nvidia updated its TensorRT-LLM for PCs with GeForce RTX 30 and 40 Series GPUs, enabling local running of large language models and enhancing privacy.

theverge.com1 min read

GEMINI DELAYS LAUNCH OF GEMINI

Google has postponed the launch of its large language model (LLM) and GPT-4 competitor Gemini until Q1 of 2024 due to concerns about its ability to match or surpass OpenAI's GPT-4 and a focus on strengthening its consumer offerings before allowing external developer access.

uctoday.com2 min read

02RESEARCH & INNOVATION

STABLE VIDEO

Trained to generate 14 frames of video, Stable Video from Stability AI is a glimpse into the future of content creation.

huggingface.co4 min read

DEEP DIVE: EXPLAINING SDXL LATENT SPACE

One of the innovations of the original Stable Diffusion model was the use of a smaller latent space for diffusion. This means the diffusion doesn’t happen on pixels but on some compressed image representation. This post dives into some ways to interpret that space for SDXL.

huggingface.co22 min read

EXACT LOOKAHEAD DECODING REDUCES INFERENCE LATENCY 2.3X

There are many ways to speed up autoregressive language model inference. One way that people are excited about is using a draft model. This requires two models but it can be slower. However, by generating related ngrams from the same model, you can alleviate the need for a draft model and speed up generation linearly.

lmsys.org14 min read

03ENGINEERING & RESOURCES

LANGCHAIN IN GO

It’s now possible to easily integrate language models into your Go programs with LangChain. This includes running local models with frameworks like Ollama.

github.comGitHub repository

THE DEVELOPER'S GUIDE TO PRODUCTION-GRADE LLM APPS

Developing LLM applications is one thing, deploying them successfully in production is another. This post cuts through the complexity, offering a developer's guide to maximizing accuracy as you transition your LLM applications from the dev environment to the rigors of production.

buildingaistuff.com4 min read

04MISCELLANEOUS

THE IMPLICATIONS OF THE OPENAI FIASCO ON STARTUPS

OpenAI’s dominant place in the developer ecosystem is suddenly at risk, presenting an opportunity for smaller companies to fill a new void. Microsoft will likely walk away as the AI winner, but perhaps other model-layer companies like Anthropic will take advantage of the disturbance.

tomtunguz.com2 min read

AI OUTPERFORMS CONVENTIONAL WEATHER FORECASTING FOR THE FIRST TIME

A study published in the journal Science revealed that Google DeepMind's AI meteorology model, GraphCast, significantly outperforms traditional weather forecasting methods, accurately predicting global weather conditions up to 10 days ahead.

arstechnica.com4 min read