HOW WE BUILT OUR CUSTOMER DATA WAREHOUSE ALL ON POSTGRES

Summary from the TLDR Web Dev newsletter

Tembo built its customer data warehouse with only PostgreSQL using foreign data wrappers (FDWs) and other PostgreSQL extensions to simplify the process. It needed to pull data from various sources, including Postgres, Prometheus, and Clerk, into a single location to create dashboards for tracking customer usage and behavior. Instead of introducing new tools and technologies, Tembo utilized FDWs to connect PostgreSQL to these data sources, creating two new FDWs, clerk_fdw, and prometheus_fdw, for Clerk and Prometheus respectively. It also used pg_cron for scheduling updates and pg_partman for partitioning to improve performance and automate data retention.