WHAT CAN LLMS NEVER DO?

Summary from the TLDR Web Dev newsletter

LLMs have an important limitation: they cannot truly generalize or extrapolate beyond their training set. For example, they can't solve word puzzles like Wordle because these tasks require iterative steps with memory that LLMs can't effectively manage. LLMs also fail to “think ahead” and their “thought” drifts over multiple steps of prompting.