Search the archive

DUCK TRACK FOR DIGITAL DATA COLLECTION

Collecting image, audio, and keystroke data from your computer is actually somewhat challenging. This library makes that process easy with the purpose of training digital Agents.

REFERENCE DPO IMPLEMENTATION

Direct preference optimization is a stable alternative to RLHF using very similar data. This repository contains an implementation for study to learn about the technique.

KANDINSKY VIDEO'S TEXT-TO-VIDEO GENERATION

Kandinsky Video involves a dual-stage text-to-video process. It crafts keyframes to outline the video's story and then smoothens transitions and movements, substantially enhancing video quality and reducing computational demands.

WHAT IS OPENAI REALLY?

It’s been five incredibly turbulent days at OpenAI, with the exit and then return of CEO Sam Altman. This article succinctly unpacks all of that dynamism and then goes on to explore whether OpenAI is the not-for-profit it declared itself to be in 2015 or something else entirely.

LLM PREDICTS CHARACTERISTICS OF COVID VARIANTS

GenSLMs, an AI model for genomic data, accurately generated gene sequences resembling recent COVID-19 variants despite being trained only on early pandemic data, showcasing its potential for predicting virus evolution and aiding research.

WHY I JUST RESIGNED FROM MY JOB IN GENERATIVE AI

ANTHROPIC MAKES ITS CLAUDE CHATBOT EVEN MORE USEFUL

Anthropic has released Claude 2.1, which can digest 200,000 tokens, hallucinates half as often and can do things like search the web.

CODEGEN RAISES $16M FOR AGENT BASED CODE WRITING

PARIS-BASED KYUTAI LAB RAISES $330M AS A RESEARCH NON-PROFIT

Many top researchers have founded a new multimodal research lab that aims to publish great work and hopefully maintain its non-profit status.

SAM ALTMAN TO RETURN AS CEO OF OPENAI

OpenAI is welcoming Sam Altman and former President Greg Brockman back following the boardroom coup, a move seen by investors as a win for the firm's mission. This shake-up includes a new board aimed at resetting OpenAI's governance and a planned investigation into the recent turmoil. Both Microsoft and Altman wish to occupy seats in an expanded board.

MICROSOFT AND NVIDIA ARE MAKING IT EASIER TO RUN AI MODELS ON WINDOWS

Microsoft has announced Windows AI Studio, a hub for developers to access and configure AI models, with tools from Azure AI Studio and Hugging Face and features like model configuration UI and performance testing templates. Nvidia updated its TensorRT-LLM for PCs with GeForce RTX 30 and 40 Series GPUs, enabling local running of large language models and enhancing privacy.

GEMINI DELAYS LAUNCH OF GEMINI

Google has postponed the launch of its large language model (LLM) and GPT-4 competitor Gemini until Q1 of 2024 due to concerns about its ability to match or surpass OpenAI's GPT-4 and a focus on strengthening its consumer offerings before allowing external developer access.

STABLE VIDEO

Trained to generate 14 frames of video, Stable Video from Stability AI is a glimpse into the future of content creation.

DEEP DIVE: EXPLAINING SDXL LATENT SPACE

One of the innovations of the original Stable Diffusion model was the use of a smaller latent space for diffusion. This means the diffusion doesn’t happen on pixels but on some compressed image representation. This post dives into some ways to interpret that space for SDXL.

EXACT LOOKAHEAD DECODING REDUCES INFERENCE LATENCY 2.3X

There are many ways to speed up autoregressive language model inference. One way that people are excited about is using a draft model. This requires two models but it can be slower. However, by generating related ngrams from the same model, you can alleviate the need for a draft model and speed up generation linearly.

LANGCHAIN IN GO

It’s now possible to easily integrate language models into your Go programs with LangChain. This includes running local models with frameworks like Ollama.

DEPLOY ANY GGUF MODEL IN 3 MINUTES

You can very quickly deploy an endpoint that serves HuggingFace-hosted models using llama.cpp and GGUF server.

THE DEVELOPER'S GUIDE TO PRODUCTION-GRADE LLM APPS

Developing LLM applications is one thing, deploying them successfully in production is another. This post cuts through the complexity, offering a developer's guide to maximizing accuracy as you transition your LLM applications from the dev environment to the rigors of production.

OPENAI RELEASES A CHATGPT FEATURE WITH A JOKE ABOUT ITS OWN CEO DRAMA

ChatGPT with voice is now available for all free users. OpenAI released it with a joke about its CEO drama.

THE IMPLICATIONS OF THE OPENAI FIASCO ON STARTUPS

OpenAI’s dominant place in the developer ecosystem is suddenly at risk, presenting an opportunity for smaller companies to fill a new void. Microsoft will likely walk away as the AI winner, but perhaps other model-layer companies like Anthropic will take advantage of the disturbance.

AI OUTPERFORMS CONVENTIONAL WEATHER FORECASTING FOR THE FIRST TIME

A study published in the journal Science revealed that Google DeepMind's AI meteorology model, GraphCast, significantly outperforms traditional weather forecasting methods, accurately predicting global weather conditions up to 10 days ahead.

EMMETT SHEAR THREATENING TO LEAVE OPENAI IF BOARD CAN’T PROVE SAM ALTMAN’S WRONGDOING

Interim OpenAI CEO Emmett Shear is reportedly threatening to leave his position at OpenAI if the board can't show evidence of Sam Altman’s wrongdoing.

AMAZON REPORTEDLY TRAINING AI WITH TWICE AS MANY PARAMETERS AS GPT-4

Amazon is gearing up to enter the AI race with Olympus, a large language model boasting 2 trillion parameters, aiming to surpass OpenAI's GPT-4 and Google's Bard in capability.

REVERB (PRODUCT)

Reverb delivers AI-powered but hallucination-free answers to online forms like RFPs and questionnaires with training from past completed forms.

OPENAI STAFF THREATENS EXODUS, JEOPARDIZING COMPANY’S FUTURE

OpenAI is in disarray following the board's ousting of CEO Sam Altman, with over 700 employees threatening to leave for Microsoft. One board member who previously supported Altman's removal now regrets his decision. Microsoft, holding a 49% stake in OpenAI, has reportedly guaranteed positions for all OpenAI employees at a new AI subsidiary.

SAM ALTMAN IS STILL TRYING TO RETURN AS OPENAI CEO

Despite being hired by Microsoft, Sam Altman and co-founder Greg Brockman are still willing to return to OpenAI if the remaining board members who fired him step down.

AMAZON’S OFFERING FREE COURSES ON GENERATIVE AI

VIDEO LLAVA

LLaVa is a recipe for training a multi-modal model from a text model. It can now work with video. The resulting model (based on Vicuna) is extremely powerful and easily achieves state-of-the-art performance in video summarization and captioning.

TEACHING SMALL LANGUAGE MODELS TO REASON

The Orca models are a set of small models from Microsoft that excel at reasoning tasks. There has been concern about validity because much of the information was kept closed. Orca 2 has now been released and the model is available on HuggingFace. It demonstrates good performance for its size, outperforming several larger models on reasoning benchmarks.

POPULAR PUBLIC MODELS LIKELY DIDN'T TRAIN ON THE TEST SET

An in-depth way to study what data was used to train language models. The results of which suggest that many closed-source models likely didn't train on popular benchmarks.

TLDRAW MAKE IT REAL STARTER

tldraw made a viral app recently that allows users to design software quickly with its paint-like interface and then use GPT-V to generate code for a web version of the design. It works surprisingly well and generates robust and working code. It also takes natural language instructions.

AI EXPLOITS

A list of exploits that have been found and responsibly disclosed in AI applications.

BETTER ITEM REPRESENTATION FOR RECOMMENDER SYSTEMS

OPENAI’S MISALIGNMENT AND MICROSOFT’S GAIN

Microsoft has dramatically altered the AI landscape by acquiring key personnel and IP from OpenAI, including co-founders Sam Altman and Greg Brockman, following Altman's firing and Brockman's resignation from OpenAI, which was struggling with its non-profit model and internal conflicts.

BAIN CAPITAL VENTURES LAUNCHES BCV LAB

Bain Capital Ventures has created a new AI incubator and technical community called BCV Labs, offering office space, events, a fellowship program, GPU credits, and recruiting support, along with funding.

AGI’S IMPACT ON TECH, SAAS VALUATIONS

The rapid advancement of AI, particularly AGI, could significantly impact the valuation of SaaS and tech companies by increasing competition, compressing margins, and reducing the demand for traditional project management and CRUD apps, while also challenging incumbents with new AI-native startups and self-serve app creation, ultimately leading to a shift in the software value chain.

the free browser extension

SALESFORCE LOOKS TO POACH OUTBOUND OPENAI STAFF

Salesforce CEO Marc Benioff has revealed the firm will provide full compensation for OpenAI staff who join Salesforce’s Einstein Trusted AI research team.

RUSTGPT

A web ChatGPT clone entirely crafted using Rust and HTMX.

MICROSOFT REBRANDS ITS AI-POWERED BING CHAT AS COPILOT

Microsoft is rebranding Bing Chat to "Copilot," unifying the name of its generative AI assistant across its products, including Bing Chat Enterprise, now also known as Copilot.

>> Access all Intel AI developer tools and resources

OPENAI ANNOUNCED TRANSITION IN LEADERSHIP

CEO Sam Altman was fired from OpenAI by the board, who stated that Altman’s departure followed a deliberative review process by the board and the board no longer has confidence in his ability to continue leading OpenAI. Greg Brockman quickly quit along with many other senior researchers.

MICROSOFT HIRES FORMER OPENAI CEO SAM ALTMAN

After a weekend of negotiations to bring back Sam Altman as OpenAI CEO following his shock firing, the company’s nonprofit board has gone another way entirely and named former Twitch CEO Emmett Shear as interim CEO. Microsoft is hiring former OpenAI CEO Sam Altman and co-founder Greg Brockman.

META DISBANDED ITS RESPONSIBLE AI TEAM

Meta has reportedly disbanded its Responsible AI team, reallocating most members to its generative AI product team and others to AI infrastructure.

ENHANCING CROSS-DOMAIN OBJECT DETECTION

This project introduces a memory-based framework. This method overcomes the limitations of previous approaches by storing source instance features in a memory module, enabling better alignment with target instances.

ADVANCED ROAD SCENE UNDERSTANDING FOR AUTONOMOUS DRIVING

TopoMLP is a system designed to understand road scenes and determine drivable paths for self-driving cars by detecting and analyzing road centerlines and traffic elements.

TRANSFER KNOWLEDGE BETWEEN MODELS

This paper explores different data optimization schemes that allow for knowledge transfer between models with minimal additional compute.