AWS DMS vs OLake Go: Choosing the Right Tool for Your Iceberg Pipeline
Compare AWS DMS and OLake Go for database-to-Iceberg pipelines: setup, CDC, schema evolution, scaling, and cost, with benchmark numbers on over 4 billion rows.
Posts tagged “Apache Iceberg”
Blogs on the topic Apache Iceberg
View All Tags
Apache Iceberg Row Lineage: Tracking Data Lineage at the Row-Level
How Apache Iceberg v3 row lineage tracks row-level changes for CDC, with a tested look at _row_id preservation across Spark 3.5 and Iceberg 1.9 vs 1.10.
Conflict-Free CDC into Apache Iceberg for Autonomous Agents
Conflict-free CDC into Apache Iceberg for AI agents: build temporal memory with OLake and ClickHouse and get past the Iceberg read amplification wall.
Apache Iceberg Table Maintenance Made Easier with OLake Fusion
OLake Fusion handles Apache Iceberg table maintenance for CDC tables: tiered compaction for small and delete files, health metrics and lower Spark cost.
50% Cheaper Iceberg Compaction: OLake Fusion vs Spark
We benchmark Spark rewrite_data_files against OLake Fusion compaction on Apache Iceberg by running a full TPCH lineitem load from Postgres to GCP, applying 200k-record CDC batches every 2 minutes, and tracking TPC-H Query 6 performance, runtime, resource usage, and infrastructure cost.
The Architect’s Guide to CDC with Apache Iceberg
Learn how to design reliable CDC pipelines into Apache Iceberg, covering ingestion patterns, delete handling, and architecture best practices.