Skip to main content
ParameterSample ValueDescription
iceberg_s3_paths3://<BUCKET_NAME>/S3 bucket path where Iceberg table data and metadata files will be stored.
aws_region<AWS_REGION>AWS region containing the S3 bucket and Glue Data Catalog resources.
aws_access_keyXXXAWS access key with sufficient permissions for S3 and Glue. Optional if using IAM role attached to running instance/pod.
aws_secret_keyXXXAWS secret key with sufficient permissions for S3 and Glue. Optional if using IAM role attached to running instance/pod.
catalog_nameolake_icebergEnter a name for your catalog.
s3_endpointhttp://<S3_ENDPOINT>Endpoint for the S3 service.
glue_additional_configtrue/falseEnable custom Glue endpoint configuration.
glue_catalog_id123456789012AWS account ID used as the Glue Data Catalog identifier.
glue_access_keyXXXAccess key for authenticating Glue catalog requests. Required when Glue credentials differ from S3 credentials.
glue_secret_keyXXXSecret key for authenticating Glue catalog requests. Required when Glue credentials differ from S3 credentials.
glue_endpointhttps://<CATALOG_ENDPOINT>Custom endpoint URL for AWS Glue or a Glue-compatible catalog service.
glue_region<GLUE_REGION>Region for the Glue catalog, if different from the S3 region. Falls back to AWS Region if not set.
arrow_writesfalseWrites data and delete files using Apache Arrow based writer and registers them in Iceberg.


πŸ’‘ Join the OLake Community!

Got questions, ideas, or just want to connect with other data engineers?
πŸ‘‰ Join our Slack Community to get real-time support, share feedback, and shape the future of OLake together. πŸš€

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!