TLDR Index
TLDR AI

TLDR AI 2023-09-08

6 sections15 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

02HEADLINES & LAUNCHES

AI GRANT SECOND BATCH ANNOUNCED

The increasingly popular and successful AI grant has announced its second cohort of start-ups. There are many notable groups included, such as GGML.

aigrant.com2 min read

ADEPT AI RELEASES AN OPEN SOURCE LLM

Persimmon, originally Adept, has released Persimmon-8B, an extremely performant 8b parameter model. It has also released inference code. There are a number of niceties - one particularly interesting tidbit is 70k unused embeddings, which allows for multimodal extensions.

adept.ai7 min read

03RESEARCH & INNOVATION

DIFFUSION

Neural fields use a multilayer perceptron (MLP) to represent a 3D scene. It turns out you can apply diffusion directly to the weights of the MLP and generate a novel 3D scene.

ziyaerkoc.com28 min read

ONE WIDE FEEDFORWARD IS ALL YOU NEED

The feedforward layers of the transformer make up a significant portion of the total weights in the network. However, if you use a single large feedforward layer shared between the encoder and decoder, you can dramatically improve inference time with minimal drops in performance.

arxiv.org18 min read

USING LLMS TO PREDICT STOCK TRENDS

This paper introduces a way to use large language models to quickly analyze long Annual Reports from companies, making it easier to understand their financial health and even predict stock prices.

arxiv.org26 min read

04ENGINEERING & RESOURCES

GENERATIVE IMAGE RESTORATION

Powerful upscaling and restoration models that use diffusion to reduce blur and sharpen image details. Model checkpoints included.

github.comGitHub repository

A BETTER UNDERSTANDING OF 3D SCENES OVER TIME

ResFields is a new kind of neural network that's really good at understanding complex 3D scenes as they change over time. By adding something called 'temporal residual layers,' it can deal with a lot more information and still stay accurate.

markomih.github.io4 min read

ONPREM.LLM

OnPrem.LLM is a simple Python package that makes it easier to run large language models on non-public or sensitive data and on machines with no internet connectivity.

github.comGitHub repository

05MISCELLANEOUS