TLDR Index

Search the archive

Full-text search across article titles and summaries. Refine with sector, year, content type, and reading-time filters.

Results

14,500 matches

WEB LLM

Web LLM is a project that runs large language models directly in the browser. It runs everything within the browser with no server support. Web LLM aims to provide AI assistants with privacy for everyone. A web demo is available.

2023.04.17
github.comGitHub repositoryTLDR

WEBGPU FUNDAMENTALS

This site contains a resources for learning WebGPU. WebGPU is an API that allows developers to draw triangles, points, and lines to textures and run computations on the GPU. It is an extremely low-level API that requires a large amount of code and serious organization of data for many apps. The resources assume readers have previous knowledge of JavaScript.

2023.04.17
webgpufundamentals.orgToolTLDR

DBDEV

dbdev is a package manager for PostgreSQL trusted language extensions.

2023.04.17
github.comGitHub repositoryTLDR

PRINCETON LAUNCHES CENTER FOR LANGUAGE AND INTELLIGENCE

Recent progress in large language models has been dominated by large industry players. However, many of the key ideas still come from academia. Princeton is hoping to continue contributions to language and intelligence with this new center. They’re hiring for research scientists, engineers, and postdoc scholars.

2023.04.17
climbing-mantis.10web.site2 min readTLDR AI

WORLD'S SIMPLEST TEXT-TO-IMAGE MODEL?

Laion just released the Paella image generation model. It uses a discrete, token based, latent space and a cross entropy denoising objective. One goal of this project is to make an image synthetics model that almost anyone can understand. Their sampling code is only 12 lines long!

2023.04.17
laion.ai6 min readTLDR AI

SO LONG HYPERPARAMETERS

What if we didn’t have to tune the pile of hyperparameters we do to make deep learning work? This is a pretty technical paper that presents Automatic Gradient Descent which is a new optimizer that takes into account network architectures and eliminates a set of previously required hyperparameters. They work through all the math thoroughly, and the resulting optimizer seems to be fairly simple. They don’t have it working yet for all network architectures, but that feels like only a matter of time.

2023.04.17
arxiv.org38 min readTLDR AI

DINOV2: LEARNING ROBUST VISUAL FEATURES WITHOUT SUPERVISION

Recent breakthroughs in natural language processing have paved the way for foundation models in computer vision, producing all-purpose visual features through self-supervised methods and large, diverse datasets. By utilizing an automatic pipeline for curated data and training a 1-billion-parameter ViT model, researchers have created smaller models that surpass existing all-purpose features in most benchmarks at image and pixel levels.

2023.04.17
arxiv.org18 min readTLDR AI

OPENAI CONSISTENCY MODELS CODE

We wrote recently about the new type of genitive model from OpenAI that is faster than diffusion and more stable than a GAN. They just released code and model checkpoints on a set of small experimental data sets. This model is a cool next step in generative image modeling, and now we can play around with it!

2023.04.17
github.comGitHub repositoryTLDR AI

TRANSFORMER

Combining spectral and multi-headed attention layers in the novel SpectFormer architecture improves transformer performance for image recognition tasks. This approach achieves state-of-the-art accuracy on ImageNet-1K and consistently strong results in transfer learning, object detection, and instance segmentation tasks across various datasets.

2023.04.17
badripatro.github.io3 min readTLDR AI

COST TO TRAIN ANTHROPIC'S NEXT MODEL

Anthropic recently announced plans to spend a billion dollars on training a massive language model. They announced this plan before their strategic partnership with Google, which may offer cheaper compute via their TPU pods. In any case it seems like one of the largest expenses of this endeavor is actually AI researcher salaries, followed closely by compute costs.

2023.04.17
orenleung.com4 min readTLDR AI

WOLVERINE

Wolverine uses GPT-4 to edit your scripts and tell you what went wrong.

2023.04.17
github.comGitHub repositoryTLDR AI

CRYPTOCURRENCY

Bhutan's sovereign investment arm, Druk Holding & Investments, quietly invested millions of dollars in cryptocurrencies like Bitcoin and Ether. This was revealed in the bankruptcy filings of crypto lenders BlockFi and Celsius, both of which Druk was an institutional customer. The fund has been accused of defaulting on a $30 million loan from BlockFi, though Druk’s CEO claims the matter has been settled. Druk's involvement in cryptocurrencies raises questions about the nation's relationship with the volatile crypto market, and it appears to be the first sovereign wealth fund to directly own cryptocurrencies.

2023.04.17
archive.md6 min readTLDR Crypto

SUI ANNOUNCED ITS TOKEN LAUNCH MECHANICS

The crypto ecosystem received long-awaited details on the Sui public launch over the weekend with the announcement of its upcoming public token sale. In conjunction with this, the SUI Token Community Access Program was announced, with plans to reward early Sui network supporters such as testers, community managers, and builders with retrospective awards and recognition sale opportunities. The general public can also participate by purchasing SUI tokens on exchanges like KuCoin and OKX. Instead of an airdrop, SUI tokens are being offered at a discounted price to early contributors and ecosystem participants. This is a different approach than some of the most recent high-profile token launches like ARB and BLUR - both of which conducted airdrops to distribute tokens.

2023.04.17
sui.io6 min readTLDR Crypto

MONEY-MARKET FUNDS

Another stablecoin company, Ondo Finance, has come on the scene. This stablecoin will be backed by money-market funds invested in US government securities. This mechanism, created by former Goldman Sachs employees, allows holders to receive a yield on their stablecoins from the yield generated via the money-market funds backing the coin. Investors will receive a digital coin called OMMF, which will invest only in low-risk money market funds. This aims to provide the price stability and on-chain utility of stablecoins while offering better investor protection and passing on yield to holders. The long-term goal of OMMF is to provide an alternative to bank settlement networks or other stablecoins, as well as to become a preferred collateral asset in crypto lending.

2023.04.17
archive.md2 min readTLDR Crypto

WEB-LLM: LARGE-LANGUAGE MODELS AND CHAT LOCALLY IN WEB BROWSERS

Web-LLM brings language model chats directly onto web browsers. Everything runs inside the browser with no server support and accelerated with WebGPU. It brings a lot of fun opportunities to build AI assistants for everyone and enables privacy while enjoying GPU acceleration.

2023.04.17
github.comGitHub repositoryTLDR Web Dev

ARCHIVE AND MORE

Wayback is a tool that supports running as a command-line tool and docker container, purpose to snapshot web pages to time capsules. It is a self-hosted archiving service integrated with Internet Archive, archive.today, IPFS and beyond.

2023.04.17
github.comGitHub repositoryTLDR Web Dev

Sponsored

INFRASTRUCTURE ENGINEERS JUST GOT A COPILOT

2023.04.17
infracopilot.io%20for%20utm%20-%20SponsorTLDR Web Dev

WHAT THE HECK IS HAPPENING AT UBER?

The recent Wall Street Journal profile of Uber CEO Dara Khosrowshahi, which featured him driving for Uber and discovering flaws in the product, has been criticized by analysts, investors and ex-employees. They are concerned about the timing of the CEO's revelation, the level of compensation he receives,S and the company's product management.

2023.04.17
bigtechnology.com7 min readTLDR Web Dev