MANY POSTS HERE ARE TEACHING BEGINNERS WRONG LESSONS ON SMALL DATA

Summary from the TLDR Dev newsletter

Some Kaggle competitions often teach beginners to overengineer solutions, leading to overfitting and worse leaderboard scores than simpler models due to the small dataset size.