Comprehensive Hands-on Walk Through of Dremio Cloud Next Gen (Hands-on with Free Trial)
November 12, 2025Walkthrough with the new trial of the Dremio Cloud Platform
42 posts tagged with "Apache Iceberg"
2025-2026 Guide to Learning about Apache Iceberg, Data Lakehouse & Agentic AI
October 23, 2025A curated guide to mastering Apache Iceberg, data lakehouse architectures, and the emerging field of Agentic AI for data professionals.
An Exploration of the Commercial Iceberg Catalog Ecosystem
October 21, 2025Dive into the world of commercial Iceberg catalogs and discover how they enhance data lakehouse architectures for modern data engineering.
Building a Universal Lakehouse Catalog - Beyond Iceberg Tables
October 17, 2025Exploring paths to a universal lakehouse catalog that supports multiple data formats and engines, building on Apache Iceberg's success.
Intro to Apache Iceberg with Apache Polaris and Apache Spark
October 16, 2025Learn how to leverage Apache Iceberg with Apache Polaris and Apache Spark to build scalable and efficient data lakehouses.
The State of Apache Iceberg v4 - October 2025 Edition
October 14, 2025What's Coming in Apache Iceberg v4: A Deep Dive into the Future of Open Table Formats
The Ultimate Guide to Open Table Formats - Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
September 24, 2025Understanding Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
The 2025 & 2026 Ultimate Guide to the Data Lakehouse and the Data Lakehouse Ecosystem
September 23, 2025What is the Data Lakehouse and the Data Lakehouse Ecosystem? This comprehensive guide covers everything you need to know about the Data Lakehouse architecture, open table formats like Apache Iceberg, Delta Lake, Apache Hudi, and Apache Paimon, and the modern data ecosystem that supports them.
The Endgame — Building an Autonomous Optimization Pipeline for Apache Iceberg
September 16, 2025Learn how to automate compaction, snapshot expiration, and layout optimization in Apache Iceberg using metadata-driven triggers and orchestration tools for a self-healing lakehouse.
Managing Large-Scale Optimizations — Parallelism, Checkpointing, and Fail Recovery
September 09, 2025Learn how to scale Apache Iceberg table optimizations across large datasets using parallelism, checkpointing, and fail recovery to ensure reliability and performance.
Unlocking the Power of Agentic AI with Apache Iceberg and Dremio
September 05, 2025Unlocking the Power of Agentic AI with Apache Iceberg and Dremio
Hidden Pitfalls — Compaction and Partition Evolution in Apache Iceberg
September 02, 2025Partition evolution in Apache Iceberg is a powerful feature, but if not managed carefully, it can introduce fragmentation and impact compaction performance. Learn how to handle it effectively.
Using Iceberg Metadata Tables to Determine When Compaction Is Needed
August 26, 2025Discover how to use Apache Iceberg's metadata tables to proactively detect small files, bloated manifests, and table fragmentation—so you can trigger compaction only when it's needed.
Designing the Ideal Cadence for Compaction and Snapshot Expiration
August 19, 2025Learn how to design an effective schedule for compaction and snapshot expiration in Apache Iceberg to balance cost, performance, and data freshness.
Avoiding Metadata Bloat with Snapshot Expiration and Rewriting Manifests
August 12, 2025Learn how to prevent and clean up metadata bloat in Apache Iceberg by expiring snapshots and rewriting manifests for better performance and manageability.
Smarter Data Layout — Sorting and Clustering Iceberg Tables
August 05, 2025Improve query performance in Apache Iceberg by organizing your data layout with sorting and Z-order clustering. Learn how to reduce scan cost and improve filter effectiveness.
Optimizing Compaction for Streaming Workloads in Apache Iceberg
July 29, 2025Learn how to design fast, incremental compaction strategies in Apache Iceberg to support high-throughput streaming pipelines without disrupting freshness or performance.
The Basics of Compaction — Bin Packing Your Data for Efficiency
July 22, 2025Learn how standard compaction works in Apache Iceberg and why bin packing your data files is essential for maintaining query performance and cost efficiency.
The Cost of Neglect — How Apache Iceberg Tables Degrade Without Optimization
July 15, 2025Learn how Apache Iceberg tables can degrade over time without optimization and what issues this causes for performance, cost, and governance.
Understanding Apache Iceberg Delete Files
August 29, 2024Continuing the Understand Apache Iceberg series, this article delves into the Manifest, a critical component of Apache Iceberg's architecture.
Understanding the Apache Iceberg Manifest
August 27, 2024Continuing the Understand Apache Iceberg series, this article delves into the Manifest, a critical component of Apache Iceberg's architecture.
Understanding the Apache Iceberg Manifest List (Snapshot)
August 25, 2024Continuing the Understand Apache Iceberg series, this article delves into the Manifest List, a critical component of Apache Iceberg's architecture.
Apache Iceberg Reliability
July 26, 2024Why Apache Iceberg Works
Video Course - Basics of Lakehouse Engineering - Apache Iceberg, Nessie, Dremio
June 26, 2024Introductory Course to Data Engineering for Apache Iceberg Lakehouses
Partitioning with Apache Iceberg - A Deep Dive
May 29, 2024Benefits of Apache Iceberg Partition Evolution and Hidden Partitioning
3 Reasons Data Engineers Should Embrace Apache Iceberg
May 15, 2024Benefits of Apache Iceberg
Running SQL on your Excel Files From Your Laptop with Dremio
May 03, 2024How to run SQL on your Excel files easily
A Deep Intro to Apache Iceberg and Resources for Learning More
April 04, 2024Learning about Apache Iceberg
Understanding the Future of Apache Iceberg Catalogs
April 04, 2024Java, Rest and the expanding open lakehouse ecosystem
End-to-End Basic Data Engineering Tutorial (Spark, Dremio, Superset)
April 01, 2024Ingesting Data and Building BI Dashboards
5 Open Source Data Projects You Should Be Following
March 19, 2024Apache Iceberg, Apache Arrow, Nessie, Ibis, Substrait
5 Reasons Dremio is the Ideal Apache Iceberg Lakehouse Platform
March 09, 2024Understanding how catalogs work and which one to choose
The Apache Iceberg Lakehouse - The Great Data Equalizer
March 06, 2024Disrupting the Snowflake/Databricks status quo
10 Reasons to Make Apache Iceberg and Dremio Part of Your Data Lakehouse Strategy
March 01, 2024Understanding how catalogs work and which one to choose
A deep dive into the concept and world of Apache Iceberg Catalogs
March 01, 2024Understanding how catalogs work and which one to choose
Table Format FUD - Thinking Through the Table Format Conversion (Apache Iceberg, Apache Hudi, Delta Lake)
February 02, 2024Understanding how to choose a table format
Embracing the Future of Data Management - Why Choose Lakehouse, Iceberg, and Dremio?
January 25, 2024The Future of Data Platforms
Open Lakehouse Engineering/Apache Iceberg Lakehouse Engineering - A Directory of Resources
January 19, 2024Resources for learning how to Engineer an Open Data Lakehouse
Nessie - An Alternative to Hive & JDBC for Self-Managed Apache Iceberg Catalogs
January 08, 2024Nessie is the only open-source catalog implementation specifically for Apache Iceberg.
Apache Iceberg, Git-Like Catalog Versioning and Data Lakehouse Management - Pillars of a Robust Data Lakehouse Platform
January 03, 2024This is where the combined power of Dremio’s Lakehouse Management features and Project Nessie's catalog-level versioning comes into play.
Why Dremio is a must for Apache Iceberg Data Lakehouses
November 30, 2023Why is Dremio so useful for Apache Iceberg data lakehouses
Understanding Spark Configurations with Apache Iceberg
November 22, 2022How to configure Spark for using Apache Iceberg