Last updated:|... min read
Component | Data Type | Example Value | Description |
---|---|---|---|
namespace | string | my_db | Groups streams that belong to a specific database or logical category |
stream_name | string | "table1" , "table2" | The identifier for the stream. Should match the stream name defined in the stream configurations. |
partition_regex | string | "/{dropoff_datetime, year}" | A pattern defining how to partition the data. To read more, refer the Partition Regex Documentation |
normalization | boolean | true | Determines whether OLake applies level-1 JSON flattening to Level 0 nested objects. Set to true if you require normalized output; otherwise, use false . |
append_mode | boolean | false | To disable upserts in iceberg by setting this to true . |
filter | string | "UPDATED_AT >= \"08-JUN-25 07.19.23.690870000 AM\"" | Only the data that satisfies the specified condition will be synced. |