Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

GENERAL

TLDR AI

NOTES ON POPE LEO XIV'S ENCYCLICAL ON AI

Pope Leo XIV recently released a document on the ethics of integrating AI into modern society. It touches on the environmental impact of the technology, covers the risks of algorithmic systems that make decisions that impact people's lives, discusses how AI amplifies the power of those with resources, and more. A link to the document is available in the article. The writing style is very approachable, even to non-Catholics.

ON-POLICY DISTILLATION

On-policy distillation trains a student model on trajectories sampled from its own policy while a teacher provides dense token-level supervision through KL-based regularization, closing the train-inference distribution mismatch that off-policy methods suffer. The canonical formulation unifies forward-KL, reverse-KL, and JSD losses with reverse-KL emerging as the default for mode-seeking smaller students, and a one-line code swap of the regularizer model on top of an RL stack like Tinker implements the technique.

TLDR IndexPage 3