PACT

Summary from the TLDR AI newsletter

PACT (Pairwise Auction Conversation Testbed) is a benchmark for conversational bargaining by language models. It allows researchers to study haggling skills in language models. The benchmark contains over 5,000 games of 20 rounds each. Results from the current top models are available in the repository.