OK, I CAN PARTLY EXPLAIN THE LLM CHESS WEIRDNESS NOW

Summary from the TLDR AI newsletter

Recent experiments suggest that GPT-3.5-turbo-instruct can play chess well compared to other LLMs due to potential differences in base model training and data quality. Various prompting techniques and examples enhanced chess performance of other models like GPT-4o, though not to the same extent. The analysis indicates OpenAI's strategy might involve curating high-quality chess data for better LLM performance.