ENGINEERING A TRACE DETAILS PAGE THAT HANDLES A MILLION SPANS

Summary from the TLDR Web Dev newsletter

It's a challenge to visualize traces with millions of spans in a browser without performance issues. However, Signoz was able to do so by using virtualization to only render spans within the user's viewport, optimizing database queries for fast data retrieval, and flattening the hierarchical trace data using a pre-order traversal for efficient pagination. It also added smart windowing, dynamically adjusting the data based on user interactions to provide a smoother debugging experience by only loading relevant spans.