Search the archive

LLAMA CPU FORK

FOR CRM

RUN STABLE DIFFUSION IN THE BROWSER WITH WEBGPU

This project brings stable diffusion models to web browsers. Everything runs inside the browser with no need of server support. This is the first example of the pre-trained model running on a client’s GPU from the browser. It still has some rough edges and sometimes results in browser crashing, but it is an exciting step towards a more modular future.

HOW GOOGLE BECAME CAUTIOUS OF AI AND GAVE MICROSOFT AN OPENING

More than two years ago, a pair of Google researchers started pushing the company to release a powerful chatbot. The conversational AI they had developed could confidently debate philosophy and banter about its favorite TV shows, while improvising puns about cows and horses. The researchers told colleagues that chatbots like theirs, supercharged by recent advances in AI, would revolutionize the way people searched the internet and interacted with computers, according to people who heard the remarks. They pushed Google to give access to the chatbot to outside researchers, tried to get it integrated into the Google Assistant virtual helper and later asked for Google to make a public demo available. Google executives rebuffed them at multiple turns.

LARGE LANGUAGE MODELS DO IN-CONTEXT LEARNING DIFFERENTLY

As model size increases large language models seem to exhibit some amazing emergent behavior. This paper explores the phenomenon of “in-context learning”. They find that smaller models rely on their semantic priors and ignore examples that are wrong while larger models learn from the new examples.

MODELS

Researchers from Microsoft introduce Visual ChatGPT, a system that combines ChatGPT language model with different visual models, enabling users to interact with ChatGPT using both language and images. The system allows users to provide feedback and ask for corrected results. It injects visual model information into ChatGPT and considers models with multiple inputs/outputs and those that require visual feedback.

X-AVATAR: EXPRESSIVE HUMAN AVATARS

X-Avatar is a new avatar model that captures the full expressiveness of digital humans. It can be learned from 3D scans or RGB-D data and models bodies, hands, facial expressions, and appearance holistically. The method uses a learned forward skinning module and novel sampling strategies. The paper also contributes a new dataset called X-Humans. The proposed method outperforms strong baselines on the animation task.

VISUAL PERCEPTION WITH PRE-TRAINED DIFFUSION MODELS

VPD (Visual Perception with Pre-trained Diffusion Models) is a framework that leverages the high-level and low-level knowledge of a pre-trained text-to-image diffusion model to downstream visual perception tasks.

DIFFUSION MODELS FOR ROBOTICS

If you diffuse a motion path, robotic control becomes significantly more effective! The diffusion process improves the ability of robot manipulators to accomplish challenging tasks.

EMERGENT ABILITIES OF LARGE LANGUAGE MODELS

THE AI FUTURE OF FRONTEND DEVELOPMENT

LEETCODE PROBLEM

The creator ran ChatGPT against every single challenge and recorded the results. The author explores everything he’s learned in exploring AI and ChatGPT to solve this specific niche of problems.

LLAMA-DL

Llama-dl is a high-speed download of Facebook's LLaMA model.

TSAI

Tsai is an open-source deep learning package.

CRYPTO BANK SILVERGATE ANNOUNCES 'VOLUNTARY LIQUIDATION'

RELATIONSHIP

ONBOARD THEIR USERS TO WEB3

CAT IN A BOX - FROM ZERO TO HERO

PERPETUALS?

THE ULTIMATE GUIDE TO KAVA

CRYPTO INVESTING

BITCOIN WHALES HAVE BEEN SWIMMING IN DIFFERENT DIRECTIONS

MAKERDAO EYES MORE US TREASURY AND BOND INVESTMENTS

DIRECTION FROM CONGRESS'

LIST OF POTENTIAL AIRDROPS THROUGH 2023-2024

IS COINBASE THE INDEX FUND OF CRYPTO?

CHIP

META PLANNING THOUSANDS OF MORE CUTS AFTER WIDESPREAD LAYOFFS

FLORIDA STARTUP MOVES CLOSER TO BUILDING DATA CENTERS ON THE MOON

EMERGENT ABILITIES OF LARGE LANGUAGE MODELS

HOW DISCORD STORES TRILLIONS OF MESSAGES

ONLINE GRADIENT DESCENT WRITTEN IN SQL

PRODUCT OFFICER PALI BHAT

WHY THE FLOPPY DISK JUST WON’T DIE

SOC

TECH LAYOFFS ARE BAD NEWS FOR MBA GRADS SEEKING JOBS

While tech companies are still hiring, less just-in-time recruiting is expected this spring, so students hoping to land a tech job must be nimble.

HAMILTON

Hamilton is a general-purpose micro-framework for creating dataflows from python functions.

SENIOR ROLES

BEARER

Bearer is a static application security testing tool that scans code and analyzes data flows to discover, filter, and prioritize security risks and vulnerabilities.

NEW IN CHROME 111

SALESFORCE $250MM GENERATIVE AI FUND

STABILITY AI ACQUIRES CLIPDROP

STATE OF COMPETITIVE ML 2022

PALM-E

The term “positive transfer” is somewhat of a holy grail for large scale models. It means that when you train on two modalities, you get better performance than you would have training on just one or the other. This paper from Google shows that training on robot controls, video, and text shows positive transfer between domains. This is hypothesized to be a function of model scale, and this model is an impressive 562 billion parameters.

PRISMER: A VISION-LANGUAGE MODEL WITH MULTI-MODAL EXPERTS

The article discusses the high computational and data requirements of large pre-trained models used in vision-language learning, which require massive amounts of image-text data to be trained. The proposed alternative approach involves using separate sub-networks or "experts" for specific tasks, allowing for the use of domain-specific data and architectures that would not be feasible with a single large network. The proposed model, Prismer, is a visually conditioned autoregressive text generation model that utilizes powerful vision-only and language-only models along with modality-specific vision experts for open-ended vision-language reasoning tasks. The expert models are pre-trained and frozen, and connected through lightweight trainable components, comprising only 20% of total network parameters, leading to improved training efficiency and scalability.

DAVINCI FUNCTIONS

There are common things you want to do with large language models such as text-divinci-003 such as write a list, answer a question, or verify a statement. This repo provides some simple tools for doing those tasks. It is a cool step towards building an abstraction layer on top of these models.

REPRESENTATION FROM 2D SUPERVISION

The paper introduces "Nerflets," a local neural radiance field that represents a 3D scene efficiently and with structure awareness. Nerflets are composed of multiple neural radiance fields that maintain their own spatial position, orientation, and extent to contribute to panoptic, density, and radiance reconstructions. By using only photometric and inferred panoptic image supervision, Nerflets allow the extraction of panoptic and photometric renderings from arbitrary views, and enable tasks rare for NeRFs, such as 3D panoptic segmentation and interactive editing. The experiments show that Nerflets fit and approximate the scene more efficiently than traditional global NeRFs.