TLDR Index
TLDR AI

TLDR AI 2024-02-09

5 sections18 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

GEMINI ADVANCED AND A MOBILE APP

Google launched a new service that allows you to finally interact with Gemini Ultra 1.0 - it will charge a monthly subscription for access to the model. There is also a companion mobile app.

blog.google6 min read

1X ROBOTICS DEMONSTRATION

1X is a robotics company that has made strides in video-to-control models. The company has showcased its robot performing many tasks, all driven by neural networks that emit 10hz control signals from video input.

1x.tech4 min read

02RESEARCH & INNOVATION

BOOSTING AI AGENTS' GAMEPLAY WITH TASK GUIDANCE

This paper explores the development of a generalist AI agent capable of understanding and following gameplay instructions, a step towards "read-to-play" abilities. The researchers enhance the agent's multitasking and generalization skills by integrating multimodal game instructions into a decision transformer.

arxiv.org19 min read

TRANSFORMER-BASED DECISION TREE

MetaTree is a transformer-based decision tree algorithm. It learns from classical decision tree algorithms for better generalization capabilities.

github.comGitHub repository

FUNSEARCH: MAKING NEW DISCOVERIES IN MATHEMATICAL SCIENCES USING LARGE LANGUAGE MODELS

FunSearch, a new AI-powered method that combines Large Language Models with evaluative algorithms, has made verifiable discoveries in mathematical sciences, including solutions for the longstanding cap set problem and more efficient algorithms for the bin-packing problem. It introduces evolutionary approaches to generating and evaluating code that offers human-interpretable outputs, representing a significant leap in AI-driven scientific discovery.

deepmind.google7 min read

03ENGINEERING & RESOURCES

LOCAL RAG COOKBOOK

You can build a sophisticated and powerful RAG system that runs on your hardware using Ollama, pgvector, and local data.

github.comGitHub repository

HUGGINGFACE LIGHTEVAL LIBRARY

HuggingFace released a lightweight evaluation library for language model training based on HELM and Eluther AI’s evaluation harness.

github.comGitHub repository

A VISION-LANGUAGE MODEL WITH ENHANCED VISUAL REASONING

CogCoM, a new general vision-language model, incorporates a unique Chain of Manipulations mechanism. This allows it to handle multi-turn visual reasoning by actively adjusting input images.

github.comGitHub repository

04MISCELLANEOUS

HOW WE GOT FINE-TUNING MISTRAL-7B TO NOT SUCK

HelixML was able to better fine-tune Mistral-7B by implementing a suite of qapair prompts that extracted content from all sorts of different perspectives and generating a content-addressed hash for each document.

helixml.substack.com5 min read

AN ANGEL INVESTOR COMMENTS ON AI

This point of view, from an investor, helps to bring a little context to the layers of value within AI right now by breaking them down into the infrastructure layer, like cloud providers and chip makers, modeling and core, like OpenAI and Anthropic, and AI-enhanced products, like all of you that use AI to improve your products.

lethain.com2 min read