
OLake Architecture - Fast, Modular & Scalable Data Pipeline
Explore OLake's architecture for real-time MongoDB to Iceberg replication. Learn about snapshotting, CDC, parallel processing, and open data formats.
Engineering posts from the OLake team on database replication, CDC, Apache Iceberg, lakehouse tooling and OLake release news.

Explore OLake's architecture for real-time MongoDB to Iceberg replication. Learn about snapshotting, CDC, parallel processing, and open data formats.

Compare OLake Go and Debezium+Kafka CDC tools on speed, setup ease, scalability, and cost. OLake Go offers faster, simpler, and cheaper real-time replication.

Explore common Debezium and Kafka CDC challenges including setup complexity, overhead, schema changes, and why OLake Go is a faster, simpler alternative.

Set up MongoDB CDC with Debezium and Kafka: how oplog and change streams work, connector configuration, best practices, deployment options and trade-offs.

Learn about MongoDB real-time sync strategies incremental, oplog-based, change streams, and how to overcome common data engineering challenges.

Five ways to flatten nested JSON and arrays into SQL tables with Python, pandas json_normalize and PySpark, plus how Airbyte, Hevo and Fivetran do it.