Sponsored
TLDR AI 2023-12-15
Parse notes
- Subscription/account footer truncated before parsefooter_truncated
01GENERAL
Cody is your new favorite teammate, using its deep understanding
of your codebase to explain, fix, and help you write code. Sourcegraph’s code graph [6] allows Cody to autocomplete, explain, and edit your code with much richer context [6].
🆓 Try Cody Pro — it’s FREE until February 2024
02HEADLINES & LAUNCHES
DEEPMIND’S AI UNCOVERS NOVEL MATHEMATICS
DeepMind published a paper in Nature about FunSearch, which uses LLM-guided function search to find solutions to open problems in mathematics and computer science. It tackled the capset problem and discovered some of the largest capsets to date.
OPENAI SUPERALIGNMENT GRANTS
OpenAI is distributing a number of grants for students and researchers hoping to work on super alignment. Applications are due Feb 18th.
FAST AI FOUNDER LAUNCHES NEW FOR PROFIT RESEARCH LAB
Answer AI is a new lab that isn’t aiming to build new models, but instead trying to figure out truly productive and valuable uses for existing models. It aims to do fundamental research for organizations to help them unlock AI-enabled use cases.
03RESEARCH & INNOVATION
WEAK TO STRONG GENERALIZATION
This new result from the OpenAI super alignment team (with code) suggests that you can use much weaker supervisor models to steer or align a far more powerful model, an analog to weak humans aligning super intelligent models. They used GPT-2 to recover much of the alignment performance of GPT-4. One important point they note is that this method has a tractable path for dramatic improvement, unlike RLHF-like methods.
BETTER 3D SCENE UNDERSTANDING WITH LLMS
A new research approach introduces object identifiers in Large Language Models to improve understanding and answer questions about 3D scenes. This method, which focuses on identifying and relating objects in a scene, has shown promising results in making AI more adept at interpreting complex spatial relationships.
SWITCHHEAD: A MORE EFFICIENT TRANSFORMER MODEL
SwitchHead is a breakthrough in making AI models more efficient. It reduces the memory and computing needs of Transformers without losing performance.
04ENGINEERING & RESOURCES
Sponsored
🆕 NEW RELIC INTRODUCES THE INDUSTRY’S FIRST APM SOLUTION FOR AI-POWERED APPLICATIONS
New Relic is pioneering AI observability with New Relic AI Monitoring (AIM) [13]. AIM makes it easier to troubleshoot and optimize AI applications for performance, quality, cost, and responsible use of AI. With these capabilities, engineers have unprecedented visibility and insights across the AI stack. Learn more about New Relic AI
Monitoring
ROADMAP TO LEARN GENERATIVE AI IN 2024
A work-in-progress repository to help get up to speed on the latest innovations. It is mostly geared towards beginners and includes resources for learning Python, deep learning, and language modeling.
A SMART WAY TO IMPROVE HDR IMAGES
The study introduces LLF-LUT, a technique that enhances the quality of HDR photos by focusing on important image details.
NEW MULTIMODAL MODEL FROM NOUS RESEARCH (HUGGING FACE HUB)
Capybara is a new base model for language and Obsidian is the multimodal extension. It has 3B parameters and can run on edge devices like phones.
05MISCELLANEOUS
WHY STABILITY AI IS LAUNCHING A SUBSCRIPTION FEE
HOW TO THINK ABOUT THE OPENAI Q* RUMORS
Q* is unlikely to be the crucial breakthrough that leads to artificial general intelligence, but it might be an important step toward an AI with general reasoning abilities.
TWO TITANS ON THE FUTURE OF AI (WITH REID HOFFMAN & VINOD KHOSLA) (44 MINUTE PODCAST)
From the Cerebral Valley AI Summit in November, this podcast combines two interviews with tech titans, gathering their views on the future of AI and its impact on society.
06QUICK LINKS
SAMSUNG UNVEILS ITS GENERATIVE AI MODEL SAMSUNG GAUSS
Samsung unveiled its generative AI model, Samsung Gauss, which is being used for employee productivity enhancement and will be expanded to product applications. The model includes modules for language processing, coding assistance, and image editing. Alongside this, Samsung is focusing on data privacy and secure AI usage.
DOVER AI APPLICATION SORTING
Review job applications 10x faster.