Skip to main content
ComponentData TypeExample ValueDescription & Possible Values
namespacestringotter_dbGroups streams that belong to a specific database or logical category
stream_namestring"stream_0", "stream_8"The identifier for the stream. Should match the stream name defined in the stream configurations.
partition_regexstring"{now(),2025,YYYY}-{now(),06,MM}-{now(),13,DD}/{string_change_language,,}"
or
"{,1999,YYYY}-{,09,MM}-{,31,DD}/{latest_revision,,}"
A pattern defining how to partition the data. Includes date tokens (e.g., year, month, day) or other markers like language or revision indicators.
normalizationbooleanfalseDetermines whether OLake applies level-1 JSON flattening to nested objects. Set to true if you require normalized output; otherwise, use false.
append_onlybooleanfalseThe append_only flag determines whether records can be written to the iceberg delete file. If set to true, no records will be written to the delete file. Know more about delete file: Iceberg MOR and COW
chunk_columnstring""Column name to be specified, used to divide data into chunks for efficient parallel querying and extraction from the database.

Need Assistance?

If you have any questions or uncertainties about setting up OLake, contributing to the project, or troubleshooting any issues, we’re here to help. You can:

  • Email Support: Reach out to our team at hello@olake.io for prompt assistance.
  • Join our Slack Community: where we discuss future roadmaps, discuss bugs, help folks to debug issues they are facing and more.
  • Schedule a Call: If you prefer a one-on-one conversation, schedule a call with our CTO and team.

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!