Skip to main content
ComponentData TypeExample ValueDescription
namespacestringmy_dbGroups streams that belong to a specific database or logical category
stream_namestring"table1", "table2"The identifier for the stream. Should match the stream name defined in the stream configurations.
partition_regexstring"/{dropoff_datetime, year}"A pattern defining how to partition the data. To read more, refer the Partition Regex Documentation
normalizationbooleantrueDetermines whether OLake applies level-1 JSON flattening to Level 0 nested objects. Set to true if you require normalized output; otherwise, use false.
append_modebooleanfalseTo disable upserts in iceberg by setting this to true.
filterstring"UPDATED_AT >= \"08-JUN-25 07.19.23.690870000 AM\""Only the data that satisfies the specified condition will be synced.


πŸ’‘ Join the OLake Community!

Got questions, ideas, or just want to connect with other data engineers?
πŸ‘‰ Join our Slack Community to get real-time support, share feedback, and shape the future of OLake together. πŸš€

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!