TLDR Index
TLDR AI

TLDR AI 2023-04-20

5 sections12 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

02RESEARCH & INNOVATION

TRANSFORMER MATH

How many GPUs do you need? How wide should your model be? These are regularly asked questions with fairly simple calculations. This post walks through these and a bunch more interesting questions involving Transformers and the math needed to train good ones. One interesting take away is that models should not be trained for less than 200B tokens regardless of size.

blog.eleuther.ai8 min read

VISUAL INSTRUCTION TUNING

The paper proposes using machine-generated instruction-following data to instruction tune large language models (LLMs) for multimodal tasks. This resulted in LLaVA, a large multimodal model that combines a vision encoder and language-only GPT-4. LLaVA exhibits impressive multimodal chat abilities and achieved a new state-of-the-art accuracy of 92.53% when fine-tuned on Science QA in synergy with GPT-4.

llava-vl.github.io3 min read

LOW-CODE LLM: VISUAL PROGRAMMING OVER LLMS

The paper proposes Low-code LLM, a human-LLM interaction framework that uses low-code visual programming interactions to achieve more controllable responses for complex tasks. Low-code LLM includes a Planning LLM and an Executing LLM and offers controllable generation results and user-friendly interaction. The approach is demonstrated through four applications.

arxiv.org12 min read

03ENGINEERING & RESOURCES

PROMPTR

Promptr is a CLI tool for operating on your codebase using GPT. Promptr dynamically includes one or more files into your GPT prompts, and it can optionally parse and apply the changes that GPT suggests to your codebase. Several prompt templates are included for various purposes, and users can create their own templates.

github.comGitHub repository

RADIANCE FIELD

Lift3D, an inverted 2D-to-3D generation framework, addresses the limitations of NeRF-based 3D GANs by offering photorealistic output with adaptable resolution and accurate 3D annotations for downstream tasks. The framework is evaluated on autonomous driving datasets, demonstrating its ability to enhance the performance of 3D object detectors.

len-li.github.ioGitHub repository

04MISCELLANEOUS