Search the archive

Full-text search across article titles and summaries. Refine with sector, year, content type, and reading-time filters.

Results

16,636 matches

OPENAI ANNOUNCES FIRST PARTNERSHIP WITH A UNIVERSITY

OpenAI has announced its first partnership with a higher education institution, Arizona State University, which will gain full access to ChatGPT Enterprise for coursework, tutoring, research, and more, including building a personalized AI tutor and creative AI avatars for students.

2024.01.19
cnbc.com2 min readTLDR AI

MARK ZUCKERBERG’S NEW GOAL IS CREATING AGI

Mark Zuckerberg, Meta's CEO, is entering the race to develop artificial general intelligence (AGI), aiming to enhance Meta's apps and user experience. He emphasizes the need for AI talent and computing power and is considering an open-source approach to AI development, contrasting with the more closed methods of other companies.

2024.01.19
theverge.com5 min readTLDR AI

FOUNDATIONS OF VECTOR RETRIEVAL (2 HOUR READ)

This massive document outlines essentially everything one would need to know about the state of the vector retrieval field. It is a valuable resource that will take some time to dig through.

2024.01.19
arxiv.orgTLDR AI

PRETRAINING OF LARGE IMAGE MODELS

Apple has released a great paper on pretraining image models with an autoregressive loss. It measures scaling behavior and finds that like in language, these large unsupervised image models have very predictable behavior.

2024.01.19
github.com12 min readTLDR AI

TEXT-TO-IMAGE EDITING

This paper improves how images are edited using natural language instructions by tackling challenges like unclear instructions and identifying specific parts of the image to edit.

2024.01.19
arxiv.org15 min readTLDR AI

Sponsored

🆕 MOCKGPT: SIMULATE THE OPENAI API FOR TESTING AND DEVELOPMENT

Developing against OpenAI APIs can be finicky and expensive. MockGPT by WireMock [10] is a readymade mock API for ChatGPT, GPT-3.5, etc. Use it to write and test your code without fees and frustrating wait times — and switch one line of code to go live with the real API.

2024.01.19
wiremock.ioSponsorTLDR AI

3D OBJECT PLACEMENT IN IMAGE GENERATION

Compose and Conquer introduces a conditional diffusion model that excels in placing objects in three-dimensional space within generated images.

2024.01.19
github.comGitHub repositoryTLDR AI

MINUTE-LEVEL VIDEO BLOG CREATION

Vlogger is an advanced AI system capable of generating minute-long video blogs (vlogs) from user descriptions. Vlogger operates in four stages - Script, Actor, ShowMaker, and Voicer, each representing a specific aspect of vlog creation.

2024.01.19
github.comGitHub repositoryTLDR AI

8BIT HIPPO ATTENTION MAY BE 3X FASTER THAN FLASH ATTENTION V2

A quantization-aware attention alternative that speeds up inference substantially over some state-of-the-art implementations. Its creators also claim 700 TFLOPs on MI-300X. The details are sparse, but it would be quite an achievement if so.

2024.01.19
blog.hippoml.com4 min readTLDR AI

MEGA DOLPHIN PASS THROUGH MERGE

Dolphin is widely considered to be one of the strongest uncensored open models available. It is mainly built on Mixtral. This 120B model was made by merging two smaller Dolphin models together. It has been found, with Goliath 120B, that this merging process can improve overall model performance.

2024.01.19
huggingface.co4 min readTLDR AI

NEW BENCHMARK FOR CODE GENERATION

TACO is a new benchmark for assessing a system’s ability to generate code. It is substantially larger than existing datasets and contains more challenging problems. On easy problems, GPT-4 gets 30% correct, while it only achieves 2% on the hardest subset of questions.

2024.01.19
github.comGitHub repositoryTLDR AI

Sponsored

SEE HOW

Harness the power of Ray, the world's leading open-source distributed computing framework, tailored for LLMs, conversational AI, computer vision, and enterprise AI applications on Anyscale. Enable your developers to experiment quickly with different open source LLMs. Build RAG for enhanced performance, easily incorporating proprietary data and metadata for specific use cases.

2024.01.18
app.endpoints.anyscale.comSponsorTLDR AI

OPENAI MUST DEFEND CHATGPT FABRICATIONS AFTER FAILING TO DEFEAT LIBEL SUIT

A Georgia judge recently ruled against OpenAI's motion to dismiss a defamation lawsuit filed by radio host Mark Walters, who alleges that ChatGPT's “hallucinations” produced false and potentially career-damaging claims about him. This ruling allows for the exploration and decision on the merits of the case, challenging OpenAI's liability for ChatGPT's outputs and raising questions about the responsibility for AI-generated content.

2024.01.18
arstechnica.com3 min readTLDR AI

BETTER PROMPTING AND FASTER INFERENCE WITH SGLANG AND RADIX ATTENTION

LMSYS has released two new innovations for language model inference. The first is a backend change which improves overall tokens per second performance. The second is an embedded domain-specific language for complex prompting techniques which allows for prompting parallelism.

2024.01.18
lmsys.org12 min readTLDR AI

VISION FOUNDATION MODELS FOR AUTONOMOUS VEHICLES

This paper explores the challenge of developing Vision Foundation Models (VFMs) specifically for autonomous driving. By analyzing over 250 research papers, it provides insights into data preparation, pre-training, and task adaptation in AI, highlighting cutting-edge techniques like NeRF and 3D Gaussian Splatting.

2024.01.18
arxiv.org38 min readTLDR AI

ENHANCING VIDEO UNDERSTANDING

DoraemonGPT, a new AI system based on large language models, takes a step forward in understanding dynamic real-world scenarios by focusing on video tasks. It converts videos into a symbolic memory for efficient spatial-temporal querying and incorporates specialized tools and a novel planner for complex task-solving.

2024.01.18
arxiv.org16 min readTLDR AI

AUTOMATIC BLOG TO PODCAST TO YOUTUBE PIPELINE

Nathan Lambert recently released Interconnect Tools, which allows you to automate his multimodal blogging pipeline using text-to-speech, image synthesis, and his entire workflow. It allows creators to focus on writing while the tools format things into easily consumable media for their audience.

2024.01.18
github.comGitHub repositoryTLDR AI

ENHANCING LANGUAGE MODELS FOR TRANSLATION

This project proposes Contrastive Preference Optimization (CPO) to improve the performance of moderate-sized language models in machine translation. This approach, applied to the 13B parameter ALMA model, addresses the limitations of supervised fine-tuning and results in improvements.

2024.01.18
github.comGitHub repositoryTLDR AI

ALPHACODIUM: AI-DRIVEN CODE GENERATION

AlphaCodium introduces a novel approach to enhance code generation by LLMs. This multi-stage, test-based iterative process significantly improves the accuracy of models like GPT-4 in solving complex programming problems, as demonstrated on the CodeContests dataset.

2024.01.18
github.comGitHub repositoryTLDR AI

EVALUATIONS ARE ALL WE NEED

This article explores the challenges of evaluating LLMs, comparing them to human employee assessments. It discusses the difficulty in measuring the intelligence and practicality of LLMs, highlighting the limitations of current evaluation methods and the need for more effective approaches.

2024.01.18
strangeloopcanon.com15 min readTLDR AI

DETECTING URBAN VILLAGES FROM SPACE

This study introduces UV-SAM, an adaptation of the vision foundation model and the Segment Anything Model that can accurately identify the boundaries of urban villages using satellite images. Offering an efficient alternative to traditional field surveys, UV-SAM combines different image representations for precise detection.

2024.01.18
github.comGitHub repositoryTLDR AI

THE ROAD TO HONEST AI

Recent studies suggest methods to control AI honesty, such as identifying and manipulating honesty-related vectors within the AI or using unrelated questions to detect lying tendencies based on the AI's response consistency.

2024.01.18
astralcodexten.com12 min readTLDR AI

PRIVY

A privacy-first coding assistant.

2024.01.18
github.comGitHub repositoryTLDR AI

SAKANA AI RAISES $30M SEED

Sakana.ai is building a world-class research lab in Tokyo to build smaller and more efficient foundation models. The company was founded by ex-Google researchers David Ha and Llion Jones, who are responsible for breakthroughs such as Transformers, World Models, and LoRA. It has raised a 30m seed round from Brandon Reeves at Lux Capital and Jon Chu at Khosla Ventures to pioneer this effort and put Tokyo on the AI map.

2024.01.17
sakana.ai3 min readTLDR AI

STABLECODE 3B

A strong 3B model that outperforms the 7B CodeLlama model and is small enough to run locally on MacBooks.

2024.01.17
stability.ai4 min readTLDR AI

TEACHING LANGUAGE MODELS TO LISTEN

This blog explores the current dominant paradigm for taking a pretrained language model and adding multimodal capabilities. Namely, aligning the embeddings between an encoder and the text model.

2024.01.17
paul.mou.dev13 min readTLDR AI

SOLVE HARD PROBLEMS TRAINING ON EASY DATA

Hard problems have been thought to require hard data, but that data is hard to label and noisy. This work shows that fine-tuning models on related, but easy, data dramatically improves their generation capabilities on hard problems. Another data point to support fine-tuning as eliciting knowledge instead of adding knowledge.

2024.01.17
arxiv.org12 min readTLDR AI

PERSON RE-IDENTIFICATION

Researchers have developed a novel approach called Mutual Distillation Learning For Person Re-identification (MDPR) that enhances person re-identification by combining two different techniques.

2024.01.17
arxiv.org16 min readTLDR AI

Sponsored

BENCHMARKING POWER BI ON MICROSOFT FABRIC: MARKETING OR A REAL SEMANTIC LAYER SOLUTION?

Microsoft is marketing that its Direct Lake architecture on Fabric is the ideal way to run direct queries on cloud storage in Power BI. Does the data support their claim? This webinar [12] will dive deep into AtScale’s TPC-DS benchmark report [12] that tests the scalability, cost effectiveness and manageability of Microsoft Fabric Architecture.

2024.01.17
atscale.comSponsorTLDR AI

TENCENT PHOTOMAKER

One of the most viral uses of generative image models is personal stylized image generation. Historically, this required training a LoRA or using DreamBooth. Now, with the use of ID embeddings, you can dramatically improve quality while reducing computational cost, with just a single image.

2024.01.17
github.comGitHub repositoryTLDR AI

DIFFUSION MODELS FOR CONTENT SUPER RESOLUTION

Following the recent trend of repurposing diffusion models for various other vision tasks, this work improves the stability of training for super resolution and upscaling.

2024.01.17
github.comGitHub repositoryTLDR AI

ENHANCING AI UNDERSTANDING WITH CONTEXT FILTERING

FILCO is a new technique designed to improve AI systems, especially in areas like answering questions and checking facts, by giving them better context. It works by choosing the most helpful information and training models to filter out less relevant details.

2024.01.17
github.comGitHub repositoryTLDR AI