Supported Writers

OLake replicates data to multiple destinations to cater to a variety of deployment scenarios.

Whether you're storing data locally for quick access or using cloud storage services like S3 for scalability, our system is designed to integrate seamlessly.

We are also working on adding support for Iceberg to facilitate advanced analytics and data lake management.

Destination	Supported	Docs
Local Filesystem	Yes	Link
S3	Yes	Link
Iceberg	WIP	Link

Visit OLake roadmap for more information.

Before proceeding with either configuration, please ensure you have completed the getting started instructions. For more background details, refer to the README section.

📄️ Overview

Writer config Description

🗃️ Apache Iceberg

4 items

🗃️ AWS S3

3 items

📄️ Local System

OLake Local System writer description

Data Partitioning​

While not directly configured in writer.json, data partitioning is an important aspect of how your data is organized when written to storage. For more details on partitioning strategies (especially when using S3), please refer to the S3 partitioning documentation.

Upcoming Features: Iceberg Writer​

The Iceberg writer is an upcoming feature, expected to be released by the end of February 2025. Stay tuned for updates and further documentation on its configuration and usage.

If you have any further questions or need additional support, please refer to the getting started section or the OLake README.