The Daily Index — Tuesday, April 30, 2024 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

OPENAI INTRODUCES “MEMORY” FEATURE FOR CHATGPT PLUS USERS

OpenAI has launched a new "Memory" feature for ChatGPT Plus users, allowing the AI to retain information across conversations, which can be managed via settings.

links.tldrnewsletter.com · 2 min

TLDR AI

EFFORT ENGINE

Effort enables real-time adjustment of computations during LLM model inference on Apple Silicon chips, striking a balance between speed and quality. The method, which requires no retraining but requires conversion and precomputation, allows models to operate faster by loading fewer weights. The developers are seeking assistance from Swift/Metal engineers to optimize the implementation, which is available for download on GitHub.

links.tldrnewsletter.com · 3 min

TLDR AI

OPEN GATO REPLICATION: JAT

GATO by DeepMind was touted to be a generalist agent. A team associated with Hugging Face has trained and evaluated JAT, which is a Jack-of-All-Trades model that performs reasonably on a wide variety of tasks.

links.tldrnewsletter.com · 28 min

TLDR AI

FP6-LLM

Reducing floating point precision speeds up training but can be unstable. This paper shows that you can get full tensor core utilization in a new packing format without common instabilities or slowdowns from naive attempts.

links.tldrnewsletter.com · 27 min

TLDR AI

STAR-CODER 2 15B INSTRUCT

This model is trained on synthetic and human data. Permissively licensed, it achieves 72.6 on humaneval. Its developers give great insights into how to replicate their data pipeline and apply principles to other problems where synthetic data might be useful.

links.tldrnewsletter.com · 17 min

TLDR AI

JAX INTERNALS

Autodidax tutorial that shows the inner ideas in the growing Jax framework. It also introduces helpful jargon often used in the community.

links.tldrnewsletter.com · 30 min

TLDR AI

AI ISN'T USELESS. BUT IS IT WORTH IT?

This article provides a critical examination of AI and machine learning, arguing that while AI tools can be useful for certain tasks, they often fail to live up to the grand promises made by AI companies. It highlights the significant gap between AI's practical use cases, like coding assistance and language generation, and the inflated expectations set by industry narratives. The article raises concerns about the ethical and environmental costs of AI development, along with the potential for misuse and overreliance on the technology.

links.tldrnewsletter.com · 16 min

TLDR AI

BINDING PUBLIC SECTOR AI DIFFUSION

The OMB's new AI executive order policy aimed at the public sector could severely impede AI innovation due to stringent safety provisions and bureaucratic hurdles. Implemented amidst shrinking IT budgets, the regulations may not only slow AI deployment but also potentially halt projects crucial for modernizing government services. Critics worry that these constraints, coupled with funding cuts, could prevent agencies from keeping pace with technological advances in fields like healthcare.

links.tldrnewsletter.com · 6 min

TLDR AI

MOONDREAM LLAMAFILE (HUGGING FACE HUB)

A fully self-contained VLM executable that can run on edge devices based on the Moondream 2 model, which boasts powerful performance for its size.

links.tldrnewsletter.com

TLDR AI

OPENAI WILL TRAIN ITS MODELS ON FINANCIAL TIMES' CONTENT

The Financial Times has entered into a partnership with OpenAI where OpenAI will use the publication's journalism to train its AI models and develop new AI-driven features for its readers.

links.tldrnewsletter.com · 2 min