TEACHING LLMS TO BE FUNNY

Summary from the TLDR AI newsletter

Tinker recently made it possible to post-train Kimi K2, Moonshot's 1 trillion parameter model. This post takes a look at how to train the model on a qualitative reward. It shows readers how to train a model to decompose jokes into verifiable properties. The resulting model can make jokes and explain why jokes are funny. The models, code, and data needed to replicate the model in the post are available.