THE KILLER APP OF GEMINI PRO 1.5 IS VIDEO

Summary from the TLDR newsletter

Gemini Pro 1.5 is an enormous upgrade for the Gemini series. The model has a 1,000,000 token context size, much larger than Claude 2.1's 200,000 and gpt-4-turbo's 128,000 token context sizes. While the model can still miss things and hallucinate incorrect details, it is able to process and extract text information from short videos. This article contains an example where Gemini Pro 1.5 is used to extract book names from a short video.