MLSkip: Data Skipping for ML Filters via Lightweight Metadata
This work makes the case that Parquet's default min-max metadata is enough to enable pruning, and proposes an enhanced metadata structure: a size-bounded 2D convex hull that verification tools can make better use of, increasing the pruning effectiveness to 38.31%, while occupying at most 45 bytes per row group and colu...