Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

HEADLINES & LAUNCHES

TLDR AI

OPENAI'S FIRST DEVICE WITH JONY IVE COULD BE DELAYED DUE TO 'TECHNICAL ISSUES'

OpenAI and Jony Ive's partnership is struggling with some technical issues that could end up pushing back their highly anticipated AI device's release date. OpenAI and Ive are still working on the assistant's personality and potential privacy concerns. The project's budget could reportedly be challenged due to the increased computing power necessary to run mass-produced AI devices. There is still little information about the upcoming product publicly available.

WHICH TABLE FORMAT DO LLMS UNDERSTAND BEST? (RESULTS FOR 11 FORMATS)

Understanding format sensitivity in large language models is crucial for data pipeline architecture, performance optimization, and cost management. Many RAG pipelines involve ingesting documents that contain tables of data. These tables need to be formatted in a way that is easy for models to consume otherwise they may be needlessly hurting the accuracy of the overall system. Markdown-KV appears to be a good default to use in situations where accuracy is paramount. CSV and JSONL can hurt system accuracy.

ANATOMY OF A MODERN FINETUNING API

Mira Murati's AI lab, Thinking Machines, has released a language model fine-tuning API called Tinker. Tinker exposes a handle of very low-level functions to users to let them perform supervised fine-tuning and online reinforcement learning. Each training step requires sending a batch of data over the network. It offers a stable, mature infrastructure for RL and fine-tuning experiments, making it possible for anyone to be an AI researcher.

TLDR IndexPage 3