Search the archive

Full-text search across article titles and summaries. Refine with sector, year, content type, and reading-time filters.

Results

16,636 matches

TEXT-BASED IMAGE INPAINTING

This paper introduces a benchmark and two datasets for scene and handwritten texts. Featuring original, corrupted, and assistant images, the novel Global Structure-guided Diffusion Model (GSDM) leverages text structure to efficiently recover clean texts. It shows significant improvements in recognition accuracy and image quality.

2024.02.01
arxiv.org14 min readTLDR AI

LIDAR-BASED MOVING OBJECT SEGMENTATION FOR AUTONOMOUS DRIVING

MF-MOS is a new model for better detecting moving objects in autonomous driving using LiDAR technology. It uniquely separates motion and semantic information, using residual maps for motion capture and range images for semantic guidance.

2024.02.01
github.comGitHub repositoryTLDR AI

MCTS IMPLEMENTATION IN JAX

Monte Carlo Tree Search (MCTS) is a state-of-the-art search algorithm. It was used in AlphaGo and researchers are now working to integrate it with language models. MCTS is notoriously tricky to implement.

2024.02.01
github.comGitHub repositoryTLDR AI

WHAT CAN BE DONE IN 59 SECONDS

AI has gotten good enough to accomplish multiple tasks in under a minute, which means organizations and employees are going to have to emphasize using AI for good, not bad.

2024.02.01
oneusefulthing.org6 min readTLDR AI

COMMERCIALLY LICENSED LLAVA MODEL

FireLlava is a new open vision model trained on data that makes it possible to use for commercial tasks. It matches the performance of the original Llava, but not yet to the level of Llava 1.5.

2024.02.01
app.fireworks.ai4 min readTLDR AI

SERVICENOW’S STATEMENT ON AI

ServiceNow, a $150b market cap company, last week announced that its gen AI products drove the largest net new ACV contribution for its first full quarter of any of its new product family releases ever, including its original Pro SKU. We’re already seeing enterprise-level AI applications drive meaningful revenue growth – that’s cool.

2024.02.01
linkedin.com2 min readTLDR AI

UAGENTS

A library that allows for creating autonomous AI agents in Python.

2024.02.01
github.comGitHub repositoryTLDR AI

3D HEAD AVATAR RECONSTRUCTION

GPAvatar introduces a new method for creating 3D head avatars from images that use a dynamic point-based expression field and a Multi Tri-planes Attention module.

2024.02.01
xg-chu.github.io1 min readTLDR AI

POEM/1 AI POWERED CLOCK

A delightful gadget that shows the time via a poem has been launched. It uses clever prompt caching and is beautifully designed.

2024.01.31
fastcompany.com6 min readTLDR AI

APPLE CONTINUES WORK ON AI-POWERED SIRI AND MESSAGES FEATURES

Apple is preparing major artificial intelligence features for iOS 18. It is using OpenAI's ChatGPT API for internal testing to develop its own AI models. The first beta of iOS 17.4 revealed a new SiriSummarization framework that integrates AI into the Messages app for functionalities like summarization and auto-completion.

2024.01.31
9to5mac.com2 min readTLDR AI

100X FASTER CLUSTERING WITH LILAC GARDEN

A challenge in training language models is finding a diverse enough dataset for the task. Visualizing this data is even harder. This cool tool uses fast clustering and topic modeling to enable the exploration of data to improve filtering and overall quality.

2024.01.31
docs.lilacml.com12 min readTLDR AI

REPHRASING THE WEB

“Up captioning” is an idea used in many AI systems to improve labels while training. This work from Apple applies this to pre-training by rephrasing C4 as Q/A pairs, instructions, and more. The study found the rephrasing step sped up convergence by 10x, making the model dramatically more sample efficient - at the cost of the rephrasing step.

2024.01.31
arxiv.org31 min readTLDR AI

CONTINUAL LEARNING: A SURVEY

This paper offers a detailed survey of the latest advancements in continual learning, which focuses on continuously adapting to new data while retaining previous knowledge.

2024.01.31
arxiv.org13 min readTLDR AI

Sponsored

REFINING YOUR BACKLOG IS A WASTE OF (YOUR) TIME

An up-to-date backlog helps your team prioritize the right projects, but managing it is a ton of work — which shouldn’t fall on you. Let Height handle the project legwork of backlog refining, bug triage, and chasing statuses.

2024.01.31
height.appSponsorTLDR AI

PYTORCH EXPERIMENTAL FLOAT 8 TRAINING

Training models with lower precision is faster and cheaper, but unstable. There has been lots of great recent research on quantized training. This repository builds on those foundations with easy-to-read and hackable code to enable float8 training.

2024.01.31
github.com12 min readTLDR AI

SCENE FLOW ESTIMATION IN AUTONOMOUS DRIVING

DeFlow is a new method for estimating 3D motion in scenes, a skill crucial for autonomous driving. It overcomes the limitations of traditional voxelization by transitioning from voxel-based to point features using a Gated Recurrent Unit refinement and introducing a novel loss function.

2024.01.31
github.comGitHub repositoryTLDR AI

BILLION-SCALE RECOMMENDER SYSTEMS WITH GRAPH NEURAL NETWORKS

This project introduces MAcro Recommendation Graph (MAG) and Macro Graph Neural Networks (MacGNN). These approachs tackle the computational complexity of Graph Neural Networks by grouping similar behavior patterns into macro nodes, significantly reducing node count.

2024.01.31
github.comGitHub repositoryTLDR AI

OPEN SOURCE OLLAMA MOBILE APP

Enchanted is an open source app for iOS that allows you to run language models on your mobile device.

2024.01.31
github.comGitHub repositoryTLDR AI

SLICEGPT: STREAMLINING LARGE LANGUAGE MODELS EFFICIENTLY

SliceGPT introduces a novel post-training sparsification scheme to reduce the resource demands of large language models. By replacing weight matrices with smaller ones and reducing embedding dimensions, it can remove up to 25% of model parameters in major models like LLAMA2-70B and OPT 66B, while retaining up to 99% task performance.

2024.01.31
arxiv.org19 min readTLDR AI

SAM ALTMAN SAYS GPT-5 WILL BE ‘OKAY’

OpenAI CEO Sam Altman's conflicting messages about AI's potential and limitations, including alternating between hyping up advancements like GPT-5 and tempering expectations, reflect a strategic balance between generating excitement and managing public sentiment but raise questions about the true progress and impact of AI technology.

2024.01.31
thealgorithmicbridge.substack.com4 min readTLDR AI

2024.01.31
form.typeform.comTLDR AI

PLOCK

Use an LLM directly anywhere you can type.

2024.01.31
github.comGitHub repositoryTLDR AI

META RELEASES CODELLAMA 70B MODELS

Meta's new models have been fine-tuned and instruction-tuned on significantly more code. They achieve impressive performance on HumanEval, approaching GPT-4 in some respects. The models are available under the Meta license and on HuggingFace

2024.01.30
huggingface.co4 min readTLDR AI

RWKV LAUNCHES EAGLE 7B

RWKV is an architecture alternative to the dominant Transformer model. It uses a novel linear attention mechanism that makes it extremely efficient. This new checkpoint and configuration was trained on 1T tokens and surpases many other powerful 7B Transformer based models.

2024.01.30
blog.rwkv.com8 min readTLDR AI

LARGE-VOCABULARY 3D DIFFUSION MODEL WITH TRANSFORMERS

One key challenge with 3D object generation is the diversity of items that can be created. This work uses a modified architecture to improve sample efficiency and scales up the system to work with a much larger set of objects in each 3D category.

2024.01.30
ziangcao0312.github.io12 min readTLDR AI

SLICEGPT

Another potential distillation work. Importantly, this one can work on models as small as Phi-2. This means you can remove 90% of the rows and columns of weight matrices with minimal reduction to quality at almost all scales.

2024.01.30
arxiv.org27 min readTLDR AI

LEARNING UNIVERSAL PREDICTORS

Meta Learning is the process of training systems that learn to learn and can quickly adapt to new tasks. This work from Google improves Meta Learning with synthetic data generated from a Universal Turing Machine and analyzes the results experimentally and theoretically.

2024.01.30
arxiv.org33 min readTLDR AI

TRANSFORMING ARTISTIC IMAGE EDITING WITH AI

CreativeSynth is a method for artistic image editing by seamlessly integrating text and image inputs. Its diffusion model, equipped with customized attention mechanisms, enables precise style and content manipulation while preserving the original artwork's essence.

2024.01.30
arxiv.org16 min readTLDR AI

IMAGE SEGMENTATION WITH INCONSISTENCY MASKS

Inconsistency Masks (IM) are a new method for image segmentation that works even with limited data. This approach, tested on the ISIC 2018 dataset, beats traditional techniques and even outperforms models trained on fully labeled datasets.

2024.01.30
github.comGitHub repositoryTLDR AI

BIOMETRIC SECURITY WITH IMAGE DISTORTION

A new image distortion technique makes facial images unrecognizable to humans but still identifiable by AI, striking a balance between privacy and accuracy in biometric systems.

2024.01.30
github.comGitHub repositoryTLDR AI

ENHANCING HAND IMAGE GENERATION IN AI MODELS

Researchers have improved the ability of generative models like GANs and diffusion models to create realistic hand images by adding three extra channels to training images for hand annotations.

2024.01.30
arxiv.org19 min readTLDR AI

TASKINGAI

An open source platform for AI-native application development.

2024.01.30
github.comGitHub repositoryTLDR AI

VOLTRON DATA ACQUIRES CLAYPOT

The enterprise data toolkit acquired Claypot's real-time AI tools and team for an undisclosed sum. Voltron aims to continue bringing access to data to the enterprise.

2024.01.29
venturebeat.com3 min readTLDR AI