MEMGPT
Create perpetual chatbots with self-editing memory.
Full-text search across article titles and summaries. Refine with sector, year, content type, and reading-time filters.
Create perpetual chatbots with self-editing memory.
Generating a single image from a single prompt is generally fine, but fails when generating video because of the temporal changes between frames. However, consistency when changing text is quite challenging. This work tackles both of these problems and enables generations up to 512 frames long using diffusion.
SAM-Med3D is an upgraded version of the Segment Anything Model (SAM) tailored specifically for 3D medical imaging. While the original SAM struggled with 3D medical images, SAM-Med3D, trained on a vast dataset of over 131K 3D masks, delivers superior results by capturing 3D spatial details with fewer input prompts.
The repo introduces Cola, a system that uses a large language model to coordinate various vision-language models (VLMs) for improved visual reasoning.
Instruction-tune LLMs using interaction trajectories across multiple agent tasks.
DeepSparse is a CPU inference runtime that takes advantage of sparsity to accelerate neural network inference.
This study assesses the ability of large language models (LLMs) to engage in human-like multi-turn conversations.
This paper introduces SALMONN, a unique AI model that combines text understanding with the ability to process various audio inputs, from speech to music. Not only does SALMONN perform well in trained audio tasks like speech recognition, it also shows impressive emergent skills like translating speech into untrained languages.
This project presents a novel detection-centric network for lidar panoptic segmentation (LPS) and tracking, moving away from the traditional segmentation-focused methods.
Weakly supervised object localization helps find objects using only simple picture labels. The new Background Activation Suppression (BAS) method does this better by focusing on important parts of a picture and ignoring the rest, showing amazing results on several datasets.
Framework for writing language model plugins that gives you full control.
OpenAI is reportedly nearing a deal led by Thrive Capital that would push its valuation to $80 billion, tripling its value in under six months. This surge in its valuation started with OpenAI's ChatGPT launch, igniting significant investments in leading AI companies. AI entities remain investor favorites despite waning start-up funding due to their transformative potential in tech.
Universal Music is suing AI start-up Anthropic for copyright infringement, alleging the chatbot "Claude" reproduces copyrighted lyrics without permission. The music industry is contending with AI's capability to create "deepfake" songs.
This project introduces a new method called 'saliency unlearning' (Salun) that improves how AI systems forget data.
One of the main drivers of quality for the new DALLE-3 image generation model is improved data quality. This was obtained via caption upsampling with internal models. Here is an implementation with strong open-source models.
With language models becoming multimodal, we now have more ways than ever to prompt them. State of Mark prompting runs images through Segment Anything first and numbers the detected classes. It then uses that to prompt visual models.
Chat with and learn from your code repository.
This paper outlines the main ingredients to DALLE-3's amazing performance. They include a synthetic caption generator, improved modeling with latent diffusion, and improved metrics for faithfulness, style, and coherence.
Fuyu-8B, a multimodal model designed for digital agents, is now available on HuggingFace. Unlike other multimodal models, it has a simplified architecture and supports arbitrary image resolutions, responding to large images in under 100ms. Though tailored for specific applications, Fuyu-8B still excels at standard image understanding benchmarks.
Researchers present DGUA-FAS, a method designed to address anti-spoofing challenges, especially when faced with changes in domain and unfamiliar attack types. It uses a Transformer-based feature extractor and a special network to simulate unknown attacks. This approach proves more effective in handling both known and unknown threats.
Researchers introduce FACTCHD, a benchmark designed to detect when large language models, like ChatGPT, produce factually incorrect information, especially in complex scenarios.
Waymo has introduced its Waymax simulator for evaluating the performance of agents on self-driving tasks. It is written entirely in Jax.
XAgent is an open-source experimental LLM-driven autonomous agent that can automatically solve various tasks.