ENHANCING LLAMA-2 MODEL'S PERFORMANCE THROUGH IN-CONTEXT LEARNING

Summary from the TLDR AI newsletter

This paper studied in-context learning with the pretrained Llama-2 language model by retrieving 9 demonstration examples during chat-style prompts. The method, which didn't alter the model's weights, resulted in a 7x win-rate increase compared to the text-davinci-003 model, making it on par with models that underwent alignment fine-tuning.