MULTIMODAL MODELS NEED VIDEO. WE FROZE TIME TO GIVE IT TO THEM

Summary from the TLDR newsletter

PostHog's Replay Vision lets models view session recordings. This post looks at how PostHog built the tool and how it implemented a method for the model to actually see replays. It covers how PostHog built a custom rasterizer that runs hundreds of concurrent jobs across many pods. The custom rasterizer has so far rasterized more than 370 years of recordings into roughly 3.5 million videos since it was deployed in production in March.