TLDR AI

TLDR AI 2023-04-19

5 sections15 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

blog.adobe.com4 min read

02RESEARCH & INNOVATION

LEARNING TO COMPRESS PROMPTS WITH GIST TOKENS

A new technique called "gisting" has been introduced as a way to utilize multitask capabilities of language models without requiring prompts or model retraining for each task. Gisting compresses prompts into smaller sets of tokens that can be reused, resulting in computational efficiency, FLOP reductions, and speedups without significant loss in output quality. This technique was tested on two LMs, achieving up to 26x compression of prompts and up to 40% FLOPs reductions.

arxiv.org7 min read

DETRS BEAT YOLOS ON REAL-TIME OBJECT DETECTION

A new real-time end-to-end object detector called Real-Time Detection Transformer (RT-DETR) has been proposed to address the high computational cost issue of end-to-end transformer-based detectors (DETRs), which limits their practical application. RT-DETR uses an efficient hybrid encoder, IoU-aware query selection, and supports flexible adjustment of inference speed without retraining. RT-DETR achieves up to 54.8% AP on COCO val2017 and 74 FPS on T4 GPU, outperforming YOLO detectors and DINO-Deformable-DETR-R50 in both speed and accuracy.

arxiv.org7 min read

03ENGINEERING & RESOURCES

STREET FIGHTER AI

There has been recent work in making RL agents less afraid. One paper specifically talks about mitigating cowardice in models trained in RL. This is interesting in the realm of self-driving cars and terrifying in other potential applications. This repository shows how we can now train RL agents to win in a fighting game. The full training and evaluation code is available.

github.comGitHub repository

WINDOW.AI

Window AI is a browser extension that lets you configure AI models in one place and use them on the web.

github.comGitHub repository

CAMEL

Camel explores the potential of building scalable techniques to facilitate autonomous cooperation among communicative agents and provide insight into their "cognitive" processes.

github.comGitHub repository

Sponsored

octoml.aiSponsor

04MISCELLANEOUS