TLDR AI 2023-03-27
Parse notes
- Subscription/account footer truncated before parsefooter_truncated
01HEADLINES & LAUNCHES
CHARACTER AI'S NEW MODEL AND NEW FUNDING
The start up that encourages you to talk with an AI chatbot has a boost in resources with their latest round of funding. True dialogue agents are a powerful and dangerous technology. They're hoping to build them out safely for everyone.
02RESEARCH & INNOVATION
GENERATIVE RETRIEVAL RECOMMENDER SYSTEM
Most deep recommendation systems work by embedding products and then doing some sort of nearest neighbor retrieval. There are pros and cons here. This new work uses a sequence to sequence model and a discrete product embedding to recommend the next product in a sequence of customer interactions. It improves as much as 17% over some strong baselines.
GENERATED TEXT IS VERY HARD TO DETECT
With the rise of convincing text generation systems, we as a community are scrambling to build detectors. It turns out this may not even be possible, given that the LLMs are trained to mimic human language. There is some hope though by using retrieval for semantically similar generations hosted by the model providers.
03ENGINEERING & RESOURCES
NANOPALM
Inspired by NanoGPT and NanoT5, we now have NanoPaLM. PaLM is the pathways model from Google and it has some novel architectural changes that make it interesting to study. A personal favorite is the use of multi-query attention which reduces computational costs and allows for much longer context lengths.
REVERSION : DIFFUSION-BASED RELATION INVERSION FROM IMAGES
MODELS
The article discusses a new technique called Saliency-aware Noise Blending (SNB) that blends the predicted noises of two diffusion models to achieve more controllable image generation. The proposed method is training-free, and experiments show that it is highly effective in various applications.
04MISCELLANEOUS
AND SUCCEED
Brian O'Malley, managing partner at Forerunner, emphasizes the potential of AI to reshape industries, but also highlights the current stage's uncertainties and comparisons to the buzz around Web3. To make AI an essential part of daily life, he believes it needs to understand nuances in intent and emotion, similar to how GPS and camera advancements transformed mobile technology. AI should be leveraged to serve customers, with the best AI companies being those where customers don't even know AI is involved. Focusing on reliable and repeatable AI experiences will help build enduring businesses, ultimately bringing humanity back into technology-driven experiences.
THE COMING OF LOCAL LMS
05QUICK LINKS
SAM ALTMAN SAYS BIAS IS INHERENT IN CHATGPT’S DATABASE
REPLIKA RESTORES EROTIC ROLEPLAY
AI COULD HELP SEARCH FOR ALIENS
SHELL GPT
Shell GPT is a command-line productivity tool powered by GPT-3.5