What to Assert When You Test an Iceberg Pipeline
September 10, 2026Fixtures, in-memory catalogs, and golden metadata: the assertions that catch wrong rows, unsafe reruns, schema drift, and concurrent-write corruption in CI.
7 posts tagged with "PyIceberg"
Local Iceberg Development Environments: Docker, MinIO, and In-Memory Catalogs for CI
September 02, 2026Local Iceberg development environments: in-process catalogs, a Docker Compose stack with MinIO, and CI configurations that run either.
Moving Iceberg Tables Between Catalogs Without Rewriting Data
September 02, 2026Why moving Iceberg tables between catalogs is a pointer copy, and the protocol that makes a cutover safe for one table or thousands.
Serverless Iceberg Ingestion with PyIceberg and DuckDB: Micro-Batches Without a Spark Cluster
August 25, 2026Land small Iceberg micro-batches with PyIceberg and DuckDB in a serverless function. Commits, concurrency, and why Spark is the wrong default.
Building Lightweight Serverless Ingestion to Apache Iceberg with PyIceberg and DuckDB
August 19, 2026Build lightweight serverless ingestion to Apache Iceberg with PyIceberg and DuckDB, running small feeds in functions that bill for seconds.
Building Iceberg Pipelines in Python Without Standing Up Spark
July 28, 2026A large share of production transformations fit comfortably on one machine. PyIceberg, DuckDB, and branch isolation give you a production path that debugs in an IDE.
Modern Python Tooling for Apache Iceberg
June 08, 2026PyIceberg, IceFrame, and the Iceberg CLI form a complete Python toolchain for Iceberg table management. Each tool targets a different workflow from metadata inspection to data engineering.