Skip to main content
ComponentData TypeExample ValueDescription
namespacestringmy_dbGroups streams that belong to a specific database or logical category
stream_namestring"table1", "table2"The identifier for the stream. Should match the stream name defined in the stream configurations.
partition_regexstring"/{dropoff_datetime, year}"A pattern defining how to partition the data. To read more, refer the Partition Regex Documentation
normalizationbooleantrueDetermines whether OLake applies level-1 JSON flattening to Level 0 nested objects. Set to true if you require normalized output; otherwise, use false.
append_modebooleanfalseTo disable upserts in iceberg by setting this to true.
filterstring"UPDATED_AT >= \"08-JUN-25 07.19.23.690870000 AM\""Only the data that satisfies the specified condition will be synced.


💡 Join the OLake Community!

Got questions, ideas, or just want to connect with other data engineers?
👉 Join our Slack Community to get real-time support, share feedback, and shape the future of OLake together. 🚀

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!