TLDR AI

TLDR AI 2024-09-13

6 sections18 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

EXTRACTAI BY NYLAS MAKES IT EASY

There's valuable data in emails, but it's often buried under layers of text, images, and HTML. Nylas ExtractAI [4] is a new way to get that data into the hands of developers, faster and with zero effort.

nylas.comSponsor

02HEADLINES & LAUNCHES

OPENAI'S NEWEST MODEL

OpenAI has released its next model, which was trained to think before it answers. The new model was trained with reasoning traces and spends time considering before it answers. In some domains, this has led to super human performance. The model will be rate limited to 30 or so queries per user per week, but OpenAI hopes to lift that restriction soon.

links.tldrnewsletter.com8 min read

GOOGLE IS NOW ROLLING OUT GEMINI LIVE TO FREE USERS ON ANDROID

Google is rolling out Gemini Live, its conversational AI feature, to free Android users after a month of advanced user access. Users can interrupt responses with new information and receive text transcripts of their interactions. Although Gemini Live doesn't support extensions like Gmail yet, it offers ten new voice options, and more features are promised soon.

9to5google.com2 min read

03RESEARCH & INNOVATION

HTML TO MARKDOWN

Jina has released two new state-of-the-art models that take noisy HTML and parse it into clean and usable Markdown for training and reasoning.

jina.ai12 min read

CODE GENERATION WITH POLICY FILTRATION

Policy Filtration for Proximal Policy Optimization (PF-PPO) is a method designed to improve the accuracy of reinforcement learning from human feedback (RLHF) in code generation tasks.

arxiv.org16 min read

04ENGINEERING & RESOURCES

TEACHING AI TO LEARN AND REUSE TASK WORKFLOWS

Agent Workflow Memory (AWM) is a method that helps language model-based agents learn reusable task workflows from past experiences to handle complex, long-horizon tasks.

github.comGitHub repository

IMAGE-TO-3D GENERATION

Hi3D is a new model that improves the generation of multi-view consistent, high-resolution 3D images from a single input. It uses a video diffusion approach to tackle the lack of 3D awareness in traditional 2D methods, leveraging temporal consistency from video models to enhance geometry across views.

github.comGitHub repository

05MISCELLANEOUS

1-CLICK FINE-TUNING OF LLAMA 405B

Axolotal AI has partnered with Lambda Labs to show how to use its one click cluster to fine-tune the Llama 3.1 405B model. This requires 64 GPUs, but can be done with minimal infra setup due to new tools.

axolotlai.substack.com11 min read

WILL THE "AI SCIENTIST" BRING ANYTHING TO SCIENCE?

Researchers have developed an AI tool that automates scientific processes, performing tasks from hypothesis generation to experiment execution and paper writing. Its accuracy and coherence still need improvement. Critics highlight that, while AI can handle simulations in fields like quantum computing and materials science, it risks narrowing research questions and producing less meaningful knowledge. Proponents believe this AI could optimize early research stages, potentially aiding scientists in conceptualizing and scoping research projects.

spectrum.ieee.org9 min read