RESEARCHY QUESTIONS: A NEW QUESTION ANSWERING DATASET

Summary from the TLDR AI newsletter

Language models are now exceptionally skilled at answering questions. As a result, most existing benchmarks have been saturated. There is a new type of question, dubbed 'researchy', which is open-ended and requires multiple steps. This particular dataset is mined from search engine queries. It contains cases where GPT-4 struggled to answer queries.