TLDR AI · ENGINEERING & RESEARCH
META'S OPTIMIZED RECSYS INFERENCE
Summary from the TLDR AI newsletter
Meta detailed In-Kernel Broadcast Optimization (IKBO), a co-design approach that removes redundant embedding replication in recommendation inference workloads.