TLDR Data · LAUNCHES & TOOLS

APACHE DATAFUSION COMET 1.0.0 RELEASE

datafusion.apache.org5 min read

Summary from the TLDR Data newsletter

Comet, the Spark accelerator built on Apache DataFusion, reached 1.0 with semantic versioning, Spark 4 support, broader operator coverage, and extensive correctness testing against Spark's own suite. It is aimed at teams that want faster Spark execution without rewriting jobs or replacing the surrounding Spark ecosystem.