Full-text search across article titles and summaries. Refine with sector, year, content type, and reading-time filters.
This paper is a detailed review on how LLMs, known for their impressive abilities in natural language processing, can be adapted to improve recommender systems on the internet. It examines the possible roles of LLMs in various stages of the recommendation process and explores the challenges and future potential of integrating these models for more efficient, effective, and ethically-sound recommendations.
Sponsored
Data brokers collect your personal information and profit off it at the expense of your privacy. Incogni
Trying to shape AI innovation to protect workers is a bad idea. Instead, we should focus on creating institutions that ensure that everyone can thrive in an automated economy.
Two cool new features are launching in Bard soon. The first is the ability to export responses into Google sheets and the second enables code to be run in the background to improve the reliability and accuracy of outputs. Bard will be able to detect if a question requires math, logic, or code reasoning and execute code in the backend to get answers.
Salesforce is elevating new generative artificial intelligence features in its products and doubling its investment in AI startups as the company banks on the emerging technology to help resuscitate sales growth.
Self-hosted, community-driven, local OpenAI-compatible API.
A tool to converse with all chatbots simultaneously.
CEO Mark Zuckerburg recently discussed his goals with open-sourcing significant expensive AI tools in a podcast. This collection of music generation code, model weights, and evaluations is an example of just that. It allows you to generate both melody conditioned and text conditioned music. The code is fully open sourced, but model weights are not commercially open.
Bloomberg journalists found that Stable Diffusion takes racial and gender disparities to extremes that are even worse than those found in the real world, stroking fears that generative AI will perpetuate biases.
Khan Academy has introduced an AI-powered chatbot, Khanmigo, which aims to provide personalized tutoring to students. Powered by GPT-4, the bot offers guidance on a broad range of subjects and uses the Socratic method to encourage learners to solve their problems independently. While proponents believe such bots could revolutionize education, concerns about the technology's potential for error and impact on teachers' roles persist and its effectiveness is currently being studied ahead of a broader rollout in U.S. schools.
A lot of new acronyms are introduced in this work. The gist is that researchers collected a new dataset for visual instruction tuning, trained a model, and made some algorithmic tweaks along the way. The demo is really impressive, especially after the AR reveal from Apple. An exciting peak at what AI assistants might look like in the future.
Language models are well known for confidently confabulating (sometimes called hallucinating). It turns out that these models have an internal representation for truthfulness and by tweaking the model activations you can elicit a truthful response. The researchers found that by using this technique on the instruction-tuned Alpaca model, they improved TruthfulQA performance from 32.5% to 65.1%.
The paper presents Sparse-Quantized Representation (SpQR), a new format and technique that allows almost lossless compression of large language models (LLMs), overcoming the usual accuracy losses from quantization. SpQR enables powerful LLMs to run on common devices like laptops and mobile phones without performance degradation, offering over 4x memory compression gains and faster inference than traditional methods.
Advances in computer vision seemed to slow after autonomous vehicle research lost some steam, but things are picking up again. This novel technique uses a hydra of three image models to enhance the performance of natural image matting. The results are quite compelling.
In 2015, there was a breakthrough in representing continuous values with a 6D number. This work rhymes in that they propose representing videos as a 3D volume. By matching between that representation and pixel space, they can perform quite long term tracking of arbitrary pixels in a video.
Lanarky is an open-source framework to deploy LLM applications in production.
An exploration into the eerie human-like features of LLMs and how they hold promise for some fields and trouble for others.
U.S. senators introduced two separate bipartisan artificial intelligence bills on Thursday amid growing interest in addressing issues surrounding the technology. One would require the U.S. government to be transparent when using AI to interact with people and the other would establish an office to determine if the United States is remaining competitive in the latest technologies.
Two German researchers, Sophie Jentzsch and Kristian Kersting, released a paper that examines the ability of OpenAI's ChatGPT-3.5 to understand and generate humor. They discovered that ChatGPT's knowledge of jokes is fairly limited: During a test run, 90 percent of 1,008 generations were the same 25 jokes.
Tech giants, universities, and nonprofits are working to provide lessons on artificial intelligence to students in schools. There is currently no national consensus on what should be taught about the technology. Current curriculums cover a range of topics, from the basics of AI to how to program Alexa.
Sponsored
There’s endless chatter about LLMs these days. But the people who actually have interesting things to say are the ones using LLMs in the wild. Our upcoming LLMs in Production Conference
Hugging Face has released Falcon, a new open-source framework for building and deploying large language models (LLMs). Falcon is designed to be fast, efficient, and scalable, and it can be used to train and deploy LLMs on a variety of hardware platforms, including CPUs, GPUs, and TPUs.
Between the transformer powered keyboard, the amazing AR goggles, and the plethora of hardware advancements Apple might be the silent leader in consumer AI.
Google has unveiled the development of a new AI-driven function to make searching faster and easier for emails in Gmail on smartphones.
ViCo is a new technique designed to generate realistic images based on textual descriptions, with the ability to capture fine details of novel concepts from just a few examples. Unlike other methods, ViCo is light on system resources and doesn't need to fine-tune the original model's parameters, yet it still outperforms leading models by focusing on visual semantics, using an attention-based object mask and employing a unique way to reduce overfitting.
GateON is a new technique that helps neural networks learn a series of tasks without forgetting previous ones, a common problem known as 'catastrophic forgetting'. It achieves this by creating overlapping connections between tasks and protecting important knowledge from being overwritten. GateOn has a mechanism to re-activate 'fixed' neurons, making it a powerful tool for large-scale learning tasks, whether it's identifying hand-written numbers or understanding natural language.
This study presents an approach in text-to-image (T2I) research by introducing 'Prompt-Free Diffusion', a system that generates images solely based on visual inputs, with no text prompts required. It utilizes a unique structure called 'Semantic Context Encoder (SeeCoder)' to interpret a reference image, an optional image structure, and some initial noise, making it easier to create detailed, personalized images and outperforming previous image synthesis methods.
Tree of Thoughts (ToT) is an all-new powerful and flexible algorithm that advances model reasoning by 70%
This repo supports the paper "QLoRA: Efficient Finetuning of Quantized LLMs", an effort to democratize access to LLM research.
Sponsored
Join us live on 6/14 for a live launch event & demo. Be the first to see how application developers can easily run super-fast generative AI models in the cloud with the efficiency to scale and the freedom to build with the models they want.
The tech industry was deflating in 2022, but then ChatGPT came along and sparked a new AI boom. Venture capitalists have invested over $11 billion in AI start-ups since then, and companies from Moderna to Heinz have mentioned AI initiatives on recent earnings calls.
In this article, Bertrand Meyer argues that AI does not help programmers and that it is not a silver bullet for software development. He cites several reasons for this, including the fact that AI is not always accurate, can be difficult to integrate into existing workflows, and can be expensive to implement.
This guide shares strategies and tactics for getting better results from GPTs.
Google's new AI-powered search experience, Search Generative Experience (SGE), is usually helpful but the results take too long to load, which is inconvenient.
OpenAI CEO Sam Altman said Monday he was encouraged by a desire shown by world leaders to contain any risks posed by AI.
Sam Altman has a message for software developers: OpenAI has no plans to roll out any more consumer-facing products like ChatGPT, according to a now taken down blog post by a startup founder who attended a private meeting with Altman.
OpenAI is launching a grant program to support cyber security professionals using AI and combating AI enabled systems. They are accepting applications and have a number of ideas to show the types of projects they're looking to support.
Chinese tech giant Baidu is rolling out a 1 billion yuan ($145 million) AI venture fund to back startups focused on content generated by artificial intelligence applications. The fund will also launch a competition for developers who build applications off Baidu's ERNIE large language model (LLM) or integrate the model into their existing products.
Google has recorded every change to its code base for decades, including rich descriptions, changes, and fixes. They treat this as a sequence modeling problem and create a set of robust internal tools that can help software engineers be more productive. They find it to be surprisingly effective, even at novel tasks like “history informed generation”.
We’ve talked about precision before, that’s how much space it takes to store a number. And how many unique values that number can represent. When you reduce the precision, AI models take less space on the computer, but weird things start to happen because you represent fewer numbers for the parameters. This paper studies what happens when you quantize before training at scale. They start to poke at the magical 6B parameter performance barrier.
Creating realistic talking digital people that sync with any speech audio is an important challenge in the digital world. GeneFace++ is a new method that improves lip-syncing, video quality, and system efficiency, making it the first of its kind to achieve real-time talking face generation.
Large AI models can be expensive and bad for the environment, so researchers have found a more efficient way to create smaller models using a method called knowledge distillation. This approach is often better than spending money on extra data and helps create compact models that still perform well in various language tasks.
This research introduces 'Occ-BEV', a new pre-training method for autonomous driving that focuses on making better use of multiple camera views, rather than just one, thus capturing a more accurate understanding of the surrounding environment. The technique uses a unique 3D decoder to predict the 3D geometry of the environment.
The new GPT4Tools system can manage multiple visual foundation models by analyzing language content, allowing it to automatically decide, control, and use different models based on the user's needs during a conversation. Uniquely, it enables users to teach their own language model how to use tools more effectively using a simple self-instruction and LoRA approach, making conversations about image-related tasks much smoother and more efficient.
A program that provides LLMs with the ability to complete complex tasks using plugins.
Sponsored
Let's discover how to use these damn probabilistic models in the best ways possible, without sacrificing the necessary software design building blocks. Join the MLOps Community and >50 speakers
The recent MosaicML MPT models are still gaining popularity. One of the big contributions was the “Storywriter” model which could use up to 65k tokens in context. Inference with this model was painfully slow. By adding a Key/Value cache we can speed up generation by almost 10x.
Hamilton Nolan argues that CEOs are becoming increasingly unnecessary as AI becomes more sophisticated. He proposes that we should automate the CEO position and distribute the power and wealth that CEOs currently control to other stakeholders, such as workers and shareholders.
TikTok accounts are posting horrifying artificial intelligence-generated clips of murder victims — mostly children — describing their own ghastly demise.
Amazon is rolling out artificial intelligence across a dozen of its largest warehouses to screen items for damage before orders are shipped to customers.