Search the archive

Full-text search across article titles and summaries. Refine with sector, year, content type, and reading-time filters.

Results

16,596 matches

OPENAI ACADEMY

OpenAI is starting a program for low and middle income countries to expand access to AI knowledge. It also has a professional translation of MMLU (a standard reasoning benchmark) in 15 different languages.

2024.09.24
links.tldrnewsletter.com8 min readTLDR AI

APPLE INTELLIGENCE IN MORE COUNTRIES

Apple's iOS 18.1 will introduce key AI features, including an enhanced Siri, generative AI tools in Photos, and ChatGPT integration. iOS 18.2 will expand these features with localized support in various English-speaking countries and add Image Playground and Genmoji. Future updates, such as iOS 18.4, will further enhance Siri's personalization and introduce new language support.

2024.09.24
macrumors.com4 min readTLDR AI

THE PRACTITIONER'S GUIDE TO THE MAXIMAL UPDATE PARAMETERIZATION

Maximal Update Parameterization, or muP, is a way to initialize your model so that you can transfer hyperparameters at any scale. This blog from Eleuther and Cerebras includes a minimal nanoGPT example and lots of instruction on how the process works.

2024.09.24
blog.eleuther.ai31 min readTLDR AI

TEACHING DIFFUSION MODELS TO COUNT

Getting a diffusion model to generate a certain number of an object is currently challenging. This work introduces a counting token that allows a model to successfully generate just a few or very many of a certain object. It isn't perfect as it builds on base stable diffusion, but it does much better than current alternatives.

2024.09.24
ozzafar.github.io25 min readTLDR AI

EVALUATING LONG-CONTEXT MODELS

Researchers have developed a standardized evaluation protocol to compare methods for extending language models to handle long document contexts.

2024.09.24
arxiv.org19 min readTLDR AI

3D VISION TRANSFORMER

This repository hosts an implementation of a 3D Vision Transformer designed for efficient field boundary delineation using time series satellite imagery. The model leverages spatio-temporal correlations to improve accuracy and robustness, particularly in challenging conditions such as partial cloud cover.

2024.09.24
github.comGitHub repositoryTLDR AI

SPEEDING UP LONG-CONTEXT PROCESSING WITH CRITIPREFILL

CritiPrefill is a method designed to accelerate the prefilling phase of long-context processing in large language models. By identifying and skipping non-essential computations, this approach speeds up the process by up to 3x on certain models.

2024.09.24
github.comGitHub repositoryTLDR AI

IMPROVING LLM REASONING WITH MAGICORE

MAgICoRe is a new strategy to improve reasoning in large language models by addressing challenges in refinement processes. It categorizes problems by difficulty, using simpler strategies for easy tasks and multi-agent iterative refinement for harder ones.

2024.09.24
arxiv.org20 min readTLDR AI

DEVELOPING NEW MATERIALS WITH AI

By analyzing X-ray crystallography data, the model could help researchers develop new materials for many applications, including batteries and magnets.

2024.09.24
news.mit.edu6 min readTLDR AI

WHEN WILL AI OUTTHINK HUMANS?

This article explores when AI might surpass humans in cognitive volume, introducing "thought-hours" as a metric to quantify AI's cognitive output compared to human labor. Using assumptions around reading speeds and productivity, a thought-hour equates to 10,000 tokens. Current trends suggest AI could outthink humans within a decade, given the rapid growth in AI capabilities and cost efficiencies.

2024.09.24
davidvgilmore.com13 min readTLDR AI

MICROSOFT UPDATES ITS AI SUITE WITH MORE AGENTS AND COPILOTS

Microsoft is expanding its generative AI suite to include automated agents, adding features within its Copilot assistants and unveiling a new tool to help multiple workers collaboratively interact with artificial intelligence.

2024.09.24
links.tldrnewsletter.com1 min readTLDR AI

CONTEXTUAL RETRIEVAL

Anthropic shows how to semantically chunk documents, which dramatically improves performance while only costing $1/million chunks due to caching.

2024.09.23
anthropic.com12 min readTLDR AI

PROMPTING O1

This guide was missed in the excitement of OpenAI's new reasoning models. It shows how prompting this new model is different and requires simpler prompts and a more structured input context.

2024.09.23
links.tldrnewsletter.com6 min readTLDR AI

JONY IVE CONFIRMS HE'S WORKING ON A NEW DEVICE WITH OPENAI

Jony Ive is collaborating with OpenAI CEO Sam Altman on a new AI hardware project. The venture could raise $1 billion by year-end and involves key former Apple designers. Specifics of the device remain undetermined, but it aims to leverage generative AI for advanced user interactions.

2024.09.23
theverge.com2 min readTLDR AI

FINE-TUNING IMAGE-CONDITIONAL DIFFUSION MODELS IS EASIER THAN YOU THINK

Much work has been done to generalize pretrained image diffusion models into niche depth estimators and other image conditional models. This work found that by simplifying the problem and fixing a small bug, researchers were able to get substantially improved performance with less training compute.

2024.09.23
arxiv.org24 min readTLDR AI

AI FOR JQ

Simple yet powerful tool to label, embed, and classify unlabeled text at the command line. It also works on streams which gives it the ability to receive piped input from other sources.

2024.09.23
github.comGitHub repositoryTLDR AI

KYUTAI LABS RELEASES MOSHI WEIGHTS

The highly funded real-time assistant voice startup showed off its impressive tech a few months ago. It has now released a detailed technical report and several model artifacts including code and model weights.

2024.09.23
github.comGitHub repositoryTLDR AI

MOST POWERFUL LLM ON A SINGLE GPU

Solar Pro is a 22B language model that can fit on a single 80GB GPU. The goal of this project is to make the most powerful model that can run on a single device.

2024.09.23
upstage.ai12 min readTLDR AI

SAE INTUITIONS

Sparse Autoencoders are the number one tool used today to understand the internals of language models. This post explores the intuitions behind the models and some good information on how they work.

2024.09.23
adamkarvonen.github.io18 min readTLDR AI

SNAP IS INTRODUCING AN AI VIDEO-GENERATION TOOL FOR CREATORS

Snapchat has announced a new AI video-generation tool for select creators that enables video creation from text and soon image prompts. The tool, powered by Snap's foundational video models, will be available in beta on the web. Snap aims to compete with companies like OpenAI and Adobe but has not shared output examples yet.

2024.09.20
techcrunch.com2 min readTLDR AI

APPLE INTELLIGENCE IS NOW AVAILABLE IN PUBLIC BETAS

Apple has released public betas of iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1 that feature new Apple Intelligence tools like text rewriting and photo cleanup. Only the iPhone 15 Pro, iPhone 16, iPhone 16 Pro, and M1 iPads and Macs support these AI features. Final versions are expected in October.

2024.09.20
theverge.com2 min readTLDR AI

CRUISE ROBOTAXIS RETURN TO THE BAY AREA NEARLY ONE YEAR AFTER PEDESTRIAN CRASH

Cruise is resuming operations in Sunnyvale and Mountain View, with human-driven vehicles for mapping and plans to progress to supervised AV testing later this fall. This follows a settlement and leadership change after an October 2023 crash. Cruise has issued software updates and signed a partnership with Uber for robotaxi services starting in 2025.

2024.09.20
techcrunch.com2 min readTLDR AI

V-STAR: TRAINING VERIFIERS FOR SELF-TAUGHT REASONERS

V-STaR is a novel approach to improving large language models that utilizes both correct and incorrect solutions generated during self-improvement to train a verifier, which then selects the best solution at inference time. The method has shown significant improvements in accuracy on code generation and math reasoning benchmarks compared to existing approaches, potentially offering a more efficient way to enhance LLM performance.

2024.09.20
arxiv.org31 min readTLDR AI

FAST 3D GENERATION FROM SINGLE IMAGES

Vista3D is a new framework that generates 3D models from a single image in just 5 minutes. Using a two-phase approach, it quickly forms rough geometry before refining the details, capturing both visible and hidden aspects of objects for more complete 3D reconstructions.

2024.09.20
arxiv.org31 min readTLDR AI

HEART MONITORING FROM FACIAL VIDEOS

PhysMamba is a new framework designed for remote heart monitoring via facial videos, addressing challenges in capturing long-range physiological signals.

2024.09.20
github.comGitHub repositoryTLDR AI

GOT OCR

A somewhat amazing advancement in general-purpose optical character recognition (OCR) that can read text from images with great performance. This particular version dramatically improves in-the-wild OCR as well.

2024.09.20
github.comGitHub repositoryTLDR AI