SCALING TEST TIME COMPUTE OPTIMALLY CAN BE MORE EFFECTIVE THAN SCALING MODEL PARAMETERS

Summary from the TLDR AI newsletter

There is strong pressure to use compute at inference time to improve model performance. This paper showcases several methods that can be used and discusses the trade offs made between them. In general, this points towards a broader trend of squeezing performance out of smaller models.