WHY DO LLMS FREAK OUT OVER THE SEAHORSE EMOJI?

Summary from the TLDR AI newsletter

Large language models are very confident that there is a seahorse emoji. The emoji has never existed, despite some Redditors claiming it did. This post takes a look at why models might do this. Models just don't know that their belief about a seahorse emoji existing is wrong - they can only assume that 'seahorse + emoji' will produce the tokens it wants.