TLDR AI · RESEARCH & INNOVATION

SELF TRAINING SURVEY

arxiv.org31 min read

Summary from the TLDR AI newsletter

Semi supervised and self supervised learning is where machine learning models generate the training signal. This is different from standard supervised, unsupervised, and reinforcement learning. The objective function is usually data specific (e.g. masking words or rotating images). This is a good study on common techniques used and open problems in the space.