TLDR AI

TLDR AI 2023-02-21

5 sections13 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

ROBLOX IS INCORPORATING GENERATIVE AI

Popular online game Roblox is bringing Generative AI to its game universe, allowing players to use its code-writing ability to make its digital worlds even more customizable. The tool lets Roblox users create items such as buildings, terrain, and avatars; change the appearance and behavior of those things; and give them new interactive properties by typing what they want to achieve in natural language rather than complex code.

archive.ph4 min read

AI BEING USED IN CALL CENTERS

The AI in the workplace battle has begun, and its first battleground is call centers, where AI is being used to automate basic tasks and instruct the remaining humans how to do their jobs. For workers, the technology promises to eliminate the drudgery of dull, repetitive tasks such as data processing and password resets, while synthesizing huge amounts of information that can be accessed instantly.

archive.ph12 min read

02RESEARCH & INNOVATION

SPEED UP CODE 2.5X WITH PERFORMANCE IMPROVEMENT EDITS

Compilers are excellent for optimizing code, but can only do so much. This work releases a dataset and models that edit code to improve run-time performance. The intuition behind this work is that language models may have better semantic understanding of the code which provides advantages over standard static analysis.

pie4perf.com4 min read

ALIGNMENT THROUGH THE LAW

It is infeasible to specify all the possible desired outcomes to a language model agent. Alignment studies this problem through many lenses, one new lens is that of legal contracts. Legal contracts face a similar issue in that they cannot predict every “if-then” scenario, but require counterparties to reason about the spirit of the agreement, conditioned on precedence. This paper explores SOTA language model’s ability to reason similarly about fiduciary duties in contracts. The latest OpenAI models are much better than previous versions, indicating potential positive progress for alignment!

arxiv.org43 min read

03ENGINEERING & RESOURCES

RUNNING LARGE LANGUAGE MODELS ON A SINGLE GPU

FlexGen is a high-throughput generation engine for running large language models with limited GPU memory. It improves performance via “lightning fast” offloading when in limited memory environments. Benchmarks show 1 token per second on a T4 for OPT175B!

github.comGitHub repository

RUST BASED DEEP LEARNING FRAMEWORK

If you're looking for a well written, new, deep learning framework in Rust, burn seems like a good choice. Their Tensor crate is good to use standalone. This also is a fun library if you're looking to contribute to an open source project.

github.comGitHub repository

This work proposes the use of T2I-Adapters to control the generation more granularly by aligning internal knowledge in T2I models with external control signals. This approach can achieve rich control and editing effects and has practical value due to its composability and generalization ability. The proposed T2I-Adapter shows promising generation quality and a wide range of applications, according to extensive experiments.

github.comGitHub repository

04MISCELLANEOUS