SMALL BUT MIGHTY: INTRODUCING ANSWERAI-COLBERT-SMALL

Summary from the TLDR AI newsletter

ColBERT is an extremely powerful model for retrieval. This new model has only 33m parameters but achieves amazing performance on a number of benchmarks. This post explores how to train a similar model and what tricks led to strong performance.