TLDR AI 2023-10-16
Parse notes
- Subscription/account footer truncated before parsefooter_truncated
01HEADLINES & LAUNCHES
MOONHUB AI UNVEILS THE WORLD’S FIRST AI-POWERED RECRUITER
Moonhub launched its AI-powered recruiter publicly today, alongside an iconic list of 100s of partner customers like Inflection, Anthropic, You.com, Verkada, and more. Its AI helps companies start a search in minutes, hire exceptional talent 3-5x faster, and save 100s of hours per hire.
02RESEARCH & INNOVATION
FLASH DECODING FOR 8X INFERENCE SPEED UP
Flash Attention dramatically speeds up the training of large language models. However, when running inference, the batch size is usually 1. This means Flash Attention provides little benefit. Flash Decoding was developed by the same group and brings optimizations to token generation.
USING TRANSFORMERS FOR MULTIPLE LANGUAGE TASKS
Researchers explore the potential of pre-trained transformer decoders to create universal embeddings for both natural and programming languages. With minimal training on English data, these models excel in various tasks, from classification to code search.
A NEW APPROACH FOR AUDIO-VISUAL SEGMENTATION
This paper introduces the Explicit Conditional Multimodal Variational Auto-Encoder (ECMVAE) for better identification of sound sources in videos.
03ENGINEERING & RESOURCES
IMPROVING TRAFFIC PREDICTIONS WITH GRAPH MIXFORMER
Researchers have developed the Spatio-Temporal Graph Mixformer (STGM) network, a new model for predicting traffic patterns.
BUILDING A MORE POWERFUL 3D MODEL
Researchers have introduced a new way to train 3D models, making them more efficient and versatile. Using a unique approach that blends 3D and 2D information, it shows significant improvements in tasks ranging from creating realistic images to recognizing 3D objects.
SUDOLANG
04MISCELLANEOUS
LLMS FOR DUMMIES
LLMs are all the rage these days, but do you really know how they work? This article provides a high-level overview of the plumbing behind LLMs and then looks at four frameworks for LLM applications that might emerge in the startup ecosystem.