TLDR AI · ENGINEERING & RESOURCES

BREAKTHROUGH IN DENSE PIXEL WISE TRACKING, EVEN WITH OCCLUSIONS

omnimotion.github.io4 min read

Summary from the TLDR AI newsletter

In 2015, there was a breakthrough in representing continuous values with a 6D number. This work rhymes in that they propose representing videos as a 3D volume. By matching between that representation and pixel space, they can perform quite long term tracking of arbitrary pixels in a video.