Parse notes
Sponsored
Don't miss your chance to experience the latest AI breakthroughs in-person at NVIDIA GTC [4], the #1 AI conference [4]. NVIDIA CEO Jensen Huang will share the latest AI advances that are shaping our future, live at the SAP center in San Jose. With 900+ inspiring sessions [4], 300+ exhibits, and tons of unique networking events, GTC delivers something for every technical level and interest area.
Cognition announced a new system called Devin that scores 14% on SWE-Bench, a challenging benchmark that tests AI’s abilities to write code. GPT-4 scored 1.7%. This model shows strong in-context learning abilities.
This blog post from Meta outlines the infrastructure being used to train Llama 3. It talks through storage, networking, Pytorch, NCCL, and other improvements. This will lay the foundation for Meta's H100s coming online throughout the rest of this year.
Physical Intelligence (Pi) has emerged from stealth with $70 million in seed funding. The company, founded by a team of renowned robotics and AI experts, aims to develop foundation models and learning algorithms that can power a wide range of robots and physically-actuated devices.
You can steal portions of closed language models such as the embeddings layer just by using their public APIs. This can be done for a modest budget of less than $2,000.
A sequence prediction model for DNA built on the Transformer competitor Mamba. It is extremely efficient and powerful for a small model.
This project introduces a novel approach that enhances 3D object generation, producing high-quality, detailed objects from a single image.
Sponsored
DataGPT is your on-demand, always available data analyst. From simple reporting to cohort and trend analysis [11], DataGPT gives reliable, thorough, and accurate answers to natural language questions like “why did our conversions drop?” 🆕 Use Dynamic Benchmarking [11] to compare two segments in your data, including from different starting dates.
Transformer Debugger is a tool developed by OpenAI's Superalignment team to support investigations into specific behaviors of small language models. The tool combines automated interpretability techniques with sparse autoencoders.
VideoMamba is a solution that addresses the complexities of video understanding by efficiently managing local redundancy and global dependencies.
This project presents a way to improve the efficiency of Large Vision-Language Models like LLaVA-1.5, QwenVL-Chat, and Video-LLaVA by addressing the "inefficient attention" problem. Its use of FastV, a new method that optimizes these models by pruning visual tokens and learning adaptive attention patterns, leads to a significant reduction in computational costs without losing performance on tasks related to images and videos.
Researchers have created a generative AI worm called Morris II that can attack AI systems like ChatGPT, spreading autonomously while potentially stealing data. The worm uses “adversarial self-replicating prompts” to perpetuate and compromise AI email assistants, highlighting new cyberattack risks within the AI ecosystem. Security experts urge AI developers to take potential AI-driven threats seriously as AI applications become more autonomous and interconnected.
38 AI experts and 39 English experts were asked to rate and guess whether poems were written by an AI or a human. The human came in 1st place, while Bard, ChatGPT-4, and Claude came in 2nd, 3rd, and 4th places respectively, both in writing quality and their ability to fool respondents into believing their poems were authored by a human. English experts were far better at discerning which poems were written by AI, which points to a need for them to play a greater role in helping shape future versions of AI technology.
In a discussion about the need for AI regulation and transparent development practices with tech companies, Former President Barack Obama highlighted AI's potential risks and rewards and urged tech experts to engage in government roles to help shape thoughtful AI policies. The conversation also tackled First Amendment challenges and the necessity of a multi-faceted, adaptive regulatory approach for AI.
Perplexity has integrated Yelp's data to enhance chatbot responses with maps, reviews, and detailed information on restaurants to provide users with direct and rich local search results.
Google is rolling out a new feature for the Gemini web app that allows users to fine-tune AI-generated responses using options like Regenerate, Shorter, Longer, and Remove, with the goal of providing greater control over their creative content.
Microsoft announced updates focused on accessibility, like new Azure AI features for developers with disabilities, a preview of the “Speak For Me” feature for those with speech disabilities, Copilot's new skills, and a Mental Health toolkit, at its 14th Ability Summit.