Getty Images and Nvidia have enhanced their AI collaboration with the launch of Generative AI by iStock, a platform for creating stock photos tailored for small and medium businesses that uses Nvidia's Picasso model and trained on Getty and iStock libraries.
2024.01.09·theverge.com·2 min read·TLDR AI A new Copilot key, the first big change to the Windows PC keyboard layout in nearly three decades, will ship on a variety of new PCs and laptops from Microsoft’s partners, providing quick access to Microsoft’s AI-powered Windows Copilot experience straight from a keyboard button press.
2024.01.09·theverge.com·2 min read·TLDR AI One of the best coding models of last year was the DeepSeek LLM. It got close to GPT-3.5 on many benchmarks (even if it is likely 3x the size). Information about model training, token counts, model architecture, and more has been released in a technical report.
2024.01.09·arxiv.org·28 min read·TLDR AI Vision Transformers (ViT) have taken over the vision community. They still sometimes display grid-like artifacts in their embeddings. This has made the community hesitant to adopt them for downstream tasks. This work proposes an update to the positional embeddings that eliminates this issue and gives a 25%+ boost for downstream vision tasks.
2024.01.09·arxiv.org·31 min read·TLDR AI Researchers have developed a face video editing architecture that combines GAN-NeRF technology for 3D consistency and a novel stabilizer for smooth temporal coherence. This method excels in editing videos by maintaining consistent views and seamless transitions between frames.
2024.01.09·arxiv.org·16 min read·TLDR AI Sponsored
QA Wolf [11] gets web apps to 80% automated test coverage in just 4 months. They build and maintain your automated test suite, plus provide unlimited parallel test runs.
2024.01.09·qawolf.com·Sponsor·TLDR AI in QA engineering + executes >300 tests in parallel on every PR in minutes.
Portkey AI recently open sourced its gateway, which allows for routing between many different language models.
2024.01.09·github.com·GitHub repository·TLDR AI The ALOHA robotics system took the internet by storm with its incredible cooking and household task demonstration. It uses a number of interesting training techniques (mostly imitation learning). This repository contains some baseline training algorithms for the ALOHA system in simulation.
2024.01.09·github.com·GitHub repository·TLDR AI CrewAI is a platform for orchestrating role-playing, autonomous AI agents aimed at enhancing collaborative intelligence and enabling these agents to work together effectively in complex tasks. It provides a structure for sophisticated multi-agent interactions and is designed for various applications, including smart assistant platforms and automated customer service.
2024.01.09·github.com·GitHub repository·TLDR AI This project introduces the Open-Vocabulary SAM, a framework that combines the strengths of CLIP and SAM models for improved image segmentation and recognition.
2024.01.09·mmlab-ntu.com·4 min read·TLDR AI The New York Times' lawsuit against OpenAI and Microsoft claims that their AI technologies, including ChatGPT, were trained using millions of the newspaper's copyrighted articles, leading to AI-generated outputs that compete directly with the Times' services. The lawsuit seeks billions in damages and the destruction of AI models and data that used the Times' content, arguing that this constitutes copyright infringement and undermines the newspaper's investment in journalism, raising significant questions about the legalities of AI training practices and the impact of AI on traditional content creators.
2024.01.09·stratechery.com·15 min read·TLDR AI How diffusion models advance RL. This repository categorizes their applications and points towards future interdisciplinary research opportunities.
2024.01.09·github.com·GitHub repository·TLDR AI Sponsored
Unstructured news data is now accessible for analytics. Learn how NLP automates the process of sifting through thousands of articles to find ‘diamond in the rough’ insights. Read the article on Dow Jones
2024.01.09·dowjones.com·Sponsor·TLDR AI CBI Analyst is an always-on AI-driven research analyst.
A very simple implementation of inference of the new Mistral MoE model using the Tinygrad library.
2024.01.09·github.com·GitHub repository·TLDR AI Sharp-NeRF introduces a grid-based approach to Neural Radiance Fields, efficiently transforming blurry images into sharp, detailed views.
2024.01.09·benhenryl.github.io·2 min read·TLDR AI Nabla, an AI clinical notes assistant company, raised another round of funding to continue improving its technology and accelerate sales.
2024.01.08·techcrunch.com·2 min read·TLDR AI Open Interpreter is a great project that emulates OpenAI's interpreter. It now also has an OS mode and a visual mode so it can control your computer with a language model by clicking buttons and viewing the screen.
2024.01.08·changes.openinterpreter.com·6 min read·TLDR AI Apple is set to introduce generative AI-based tools, including an enhanced Siri, at its Worldwide Developers Conference in June as part of iOS 18. These innovations are based on Apple's Ajax large language model and may include features like auto-completion and summarization for core and productivity apps, AI-assisted coding in Xcode, and automated playlist creation in Apple Music
2024.01.08·macrumors.com·1 min read·TLDR AI There are lots of ways to align a language model, for example, SFT, LoRa, RLHF, DPO, Prompting, and Threatening. This work suggests using negative embeddings added to the bias terms to push model generations towards a desired outcome.
2024.01.08·alignmentforum.org·12 min read·TLDR AI Great research that shows that adding new blocks to a language model and then tuning it on an additional task prevents losing knowledge. This is demonstrated in both code and language tasks.
2024.01.08·arxiv.org·18 min read·TLDR AI A framework called GUESS has been introduced for creating human motion from text. It simplifies complex human poses into more abstract forms at various levels, making the synthesis of motion from text more concise and stable.
2024.01.08·arxiv.org·18 min read·TLDR AI DiffusionEdge is a novel edge detection model that outperforms existing methods. By integrating a diffusion probabilistic model, DiffusionEdge delivers more accurate and crisp edge maps while being resource-efficient.
2024.01.08·github.com·GitHub repository·TLDR AI This project introduces a method to adapt CLIP-like vision-language models for various tasks while retaining its generalization ability. The approach learns prompts from LLM data, avoiding the need for labeled images.
2024.01.08·muzairkhattak.github.io·4 min read·TLDR AI LLaVA-Phi is an innovative multi-modal assistant that uses the Phi-2 language model. Despite its small size of 2.7B parameters, LLaVA-Phi excels in multi-modal dialogues, combining text and visuals.
2024.01.08·arxiv.org·6 min read·TLDR AI A really great introduction to Transformers, accessible with basic math and Python skills.
2024.01.08·blog.matdmiller.com·20 min read·TLDR AI The "2023 Expert Survey on Progress in AI" reveals a scientific community divided on the pace and impact of AI development. Predictions of significant milestones have been reached earlier than expected. Over half of the respondents are optimistic about AI's impact on humanity, but concerns remain about its potential misuse, highlighting the need for research on risk mitigation.
2024.01.08·the-decoder.com·6 min read·TLDR AI An extremely in-depth look into how one might build an AI with human-like thought processes.
2024.01.08·aithought.com·70 min read·TLDR AI Sponsored
Discover the capabilities of Hugging Face models for question answering, Q&A architectures, and hands-on coding tips. DATE & TIME: Jan 10 at 6:30 PM PST.
2024.01.08·learn.interviewkickstart.com·Sponsor·TLDR AI 2024.01.08·learn.interviewkickstart.com·TLDR AI 2024.01.08·learn.interviewkickstart.com·TLDR AI V* is a new grounded visual search algorithm that boosts GPT-V (and other VLM) captcha-solving performance significantly.
2024.01.08·vstar-seal.github.io·8 min read·TLDR AI Microsoft VP Dee Templeton has joined the OpenAI board as a nonvoting observer.
2024.01.08·theverge.com·1 min read·TLDR AI Two nonfiction authors filed a class action lawsuit against Microsoft and OpenAI, alleging copyright infringement in the creation of AI systems like ChatGPT. The lawsuit follows a similar case by The New York Times and includes claims that the defendants used copyrighted works without permission. The authors are seeking to represent a broad class of impacted writers and damages of up to $150,000 per infringed work.
2024.01.08·cnbc.com·3 min read·TLDR AI The generative search company, which has seen massive adoption in tech circles, has raised another round of funding from top VCs.
2024.01.05·reuters.com·1 min read·TLDR AI OpenAI plans to launch its GPT Store sometime in the coming week. To be eligible for listing, developers have to ensure their GPTs are compliant, verify their user profile, and make their creations “public”.
2024.01.05·techcrunch.com·2 min read·TLDR AI Google is reportedly developing "Bard Advanced," an enhanced version of its Bard AI tool that will be accessible through a paid Google One subscription. This upgraded version, powered by Google's top-tier large language model Gemini Ultra, offers advanced math and reasoning capabilities compared to the current Bard running on Gemini Pro.
2024.01.05·theverge.com·2 min read·TLDR AI MUSE is a masked image generation model that uses Transformers. HuggingFace and Stability AI have worked to reproduce it in the open and have released training code, model checkpoints, and a paper. The models were not trained for as long as some of the best image diffusion models, but they show promise!
2024.01.05·huggingface.co·21 min read·TLDR AI Researchers have developed CAINet, a novel approach for improving RGB-T semantic segmentation, crucial for autonomous driving. This system uniquely combines different types of data, focusing on their complementary aspects and global context.
2024.01.05·arxiv.org·18 min read·TLDR AI While Visual question answering (VQA) has seen advancements, most models only tackle 2D reasoning, neglecting the complexity of 3D visual scenes. This research presents 3D-aware VQA.
2024.01.05·arxiv.org·21 min read·TLDR AI Retrieval Augmented Generation (RAG) is a way to include external knowledge into a language model’s generation. This library allows for training and researching state-of-the-art RAG systems.
2024.01.05·github.com·GitHub repository·TLDR AI ODTrack, a new video tracking system, improves the way we track objects in videos. Unlike older systems that struggled with connecting past and future frames, ODTrack uses a method called 'online token propagation' to better link consecutive video frames.
2024.01.05·github.com·GitHub repository·TLDR AI This survey provides an in-depth look at the vulnerability of recommender systems to 'poisoning attacks', where harmful data is intentionally added to manipulate results.
2024.01.05·github.com·GitHub repository·TLDR AI The new chip from Intel, available on a number of platforms and on-premise deployment, has excellent training throughput, flops, and decoding bandwidth.
2024.01.05·databricks.com·4 min read·TLDR AI Dropbox's new AI features have raised privacy concerns among users who fear their data might be used to train OpenAI's models, despite Dropbox's denial and a policy that requires customer consent for such use. This situation highlights a broader crisis of trust in AI and data privacy, emphasizing the need for clear communication and transparency from companies about their data usage practices.
2024.01.05·simonwillison.net·8 min read·TLDR AI