Parquet-Only Manifests in Iceberg v4: Why the Metadata Layer Is Going Columnar
August 25, 2026Iceberg v4 is moving manifests from Avro to Parquet so planners can read only the stats they need. Why the metadata layer is going columnar.
Iceberg v4 is moving manifests from Avro to Parquet so planners can read only the stats they need. Why the metadata layer is going columnar.
Trace what one tiny Iceberg commit writes, then model hourly, per-minute, and per-second cadences so streaming costs become arithmetic, not adjectives.
Iceberg v4's adaptive metadata tree, explained from first principles: why commits rewrite too much today and how the tree makes change cheaper.
Iceberg v4 is really about making the cost of a change proportional to the change. The principle, the current tax, and what the redesign pays down.