LONG CONTEXT PROMPTING FOR CLAUDE

Summary from the TLDR AI newsletter

The recent release of Claude from Anthropic had 200k tokens in context. It seemed to suffer from the “lost in the middle” problem of language models in external evals, meaning it only had 27% retrieval performance on some standard problems. However, if you add the sentence “Assistant: Here is the most relevant sentence in the context” to the prompt the retrieval performance jumps to 98%.