Understanding Spark Configurations with Apache Iceberg
November 22, 2022A breakdown of the Spark settings Apache Iceberg needs: --packages, catalog configs for Hadoop, Hive, Glue and Nessie, S3 credentials, and sample configs.
A breakdown of the Spark settings Apache Iceberg needs: --packages, catalog configs for Hadoop, Hive, Glue and Nessie, S3 credentials, and sample configs.
A plain tour of the data world: OLTP vs OLAP, warehouses, data lakes, ETL, and how Parquet, Iceberg and Arrow come together to make a data lakehouse possible.