Daily Edition · Page 9

THE DAILY INDEX

Technology, AI, software, security, crypto and business

GENERAL

TLDR AI

LEARNINGS FROM AUDITING PUBLIC EVALUATIONS

The article outlines issues faced during public evaluations of LLMs and details improvements made to benchmarks such as AUTOMATIONBENCH and OFFICEQA PRO V2. They replaced ambiguous prose descriptions with JSON schemas for better performance evaluations and introduced new grading systems to improve accuracy. A multi-layered monitoring system is suggested to prevent manipulation and ensure accurate measurement of model capabilities.

PROGRESS ON PROVABLE INFERENCE FOR LARGE LANGUAGE MODELS

It is almost impossible to verify which model produced a specific output. Cryptographic proofs of inference allow model providers to prove that preach suppose was produced which a specific model. These proofs could enable new applications and contribute to a toolkit for verifying compliance with AI pacing requirements. This post details the progress made on a powerful type of cryptographic proof uniquely fit for provable inference called zKSNARK.

ACCELERATING ENGINEERING FOR THE PHYSICAL WORLD

OpenAI is leveraging its AI models to enhance mechanical and electrical engineering processes, from design to simulation and production, speeding up internal workflows and improving industry practices. Engineers utilize models like GPT‑6 Astra for tasks such as device design, CAD model creation, and performance simulations, while collaborating with companies like Mazda to explore applications in vehicle aerodynamics.

DEEPSEEK PLANS TO TRAIN ITS NEXT-GENERATION MODEL ON HUAWEI ASCEND CHIPS

DeepSeek plans to use Huawei's Ascend AI chips to pretrain DeepSeek V5. Ascend chips have previously been used primarily for inference rather than pretraining. This will be an important test of whether Chinese AI accelerators can support the full pre-training of a frontier large language model. A successful run could reduce Chinese AI developers' dependence on Nvidia hardware and strengthen Huawei's position as an alternative for advanced AI computing.

TLDR IndexPage 9