MODERN LLMS HAVE TINY GPTS HIDDEN INSIDE THEM

Summary from the TLDR AI newsletter

It's likely that modern LLMs have tiny self-models of LLMs inside of them that allow them to better predict the next token generated by LLMs. Models approximating LLMs within themselves would open up all sorts of metacognitive abilities. It would open doors for a self-model within LLMs similar to a model humans have about themselves they call a 'self'.