Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

HEADLINES & LAUNCHES

TLDR AI

LOS ANGELES IS USING AI IN A PILOT PROGRAM TO TRY TO PREDICT HOMELESSNESS AND ALLOCATE AID

The Los Angeles County Department of Health Services is using predictive AI to prevent homelessness, identifying at-risk individuals to provide aid and successfully keeping 86% of participants housed. The program, initiated in 2021, has assisted nearly 800 households with over $4,000 in support each. Despite concerns over privacy and ethics, the AI initiative shows promise in addressing California's climbing homelessness crisis.

SELF-REASONING TOKENS, TEACHING MODELS TO THINK AHEAD

Recent experiments introduced "Reasoning Tokens" to improve the thinking process of language models like GPT-2, encouraging them to make calculations for future tokens. Early results show a 35% decrease in loss, indicating the models can indeed learn to anticipate future information. This approach could enhance the ability of language models to plan and reason in a self-supervised manner, potentially reducing the need for step-by-step explanations.

HOW DOES CHATGPT WORK? AS EXPLAINED BY THE CHATGPT TEAM

In this article, OpenAI's Evan Morikawa provides insights into ChatGPT's inner workings, covering input text processing and tokenization to prediction sampling using large language models. ChatGPT operates by turning tokens into numerical vectors (embeddings), multiplying them by a weight matrix of billions, and selecting the most probable next word. The tech is grounded in extensive pretraining to predict text based on vast internet data.

TLDR IndexPage 3