All about Iceberg Partitioning and Partitioning Writing Strategies
How Apache Iceberg partitioning works: PartitionSpec, query pruning, manifest explosion, and the fanout, clustered and partitioned writer strategies.
Blogs on OLake
Engineering posts from the OLake team on database replication, CDC, Apache Iceberg, lakehouse tooling and OLake release news.
OLake + Glue + Snowflake - A Deep Dive into Modern Data Partitioning
Replicate database data to Apache Iceberg on S3 with OLake, catalog it in AWS Glue and query the tables from Snowflake. A step-by-step setup guide.
Iceberg vs Hive Partitioning: Hidden vs Folder-Based
Hive partitions by folder layout, Iceberg tracks partitions in metadata. Compare performance, management and scalability, with a Docker walkthrough.
Run OLake Sync on EC2 with Apache Airflow Automation
Automate OLake data sync on AWS EC2 using Apache Airflow. Manage EC2 lifecycle, S3 configs, and Docker containers for seamless data integration.
OLake Iceberg Ingestion with AWS Glue Catalog and Athena
Replicate MongoDB, Postgres or MySQL to Apache Iceberg with OLake, register tables in AWS Glue Data Catalog and query them serverlessly in Amazon Athena.
OLake for Simple Iceberg Ingestion using Glue Catalog, Trino for Query
This is where the combination of OLake, Apache Iceberg, AWS Glue Data Catalog, and Trino provides a powerful, simple, and serverless solution