PHI-4

Summary from the TLDR AI newsletter

A synthetically trained language model from Microsoft that excels at a number of challenging benchmarks. The weights are coming this week. Interestingly, it confirmed the suspicion that “Mid Training” can be used for context length extension.