TLDR AI · DEEP DIVES & ANALYSIS
THE END OF THE TRAIN-TEST SPLIT
Summary from the TLDR AI newsletter
Models don't know what is 'out of distribution' for themselves. Engineers will always be required in the loop until this problem is solved. It will never be easy to check the accuracy of models. Researchers need to look at their data, make sure it's clean, and label it correctly.