Skip to main content
ParameterSample ValueDescription
Iceberg S3 Paths3a://warehouse/ or gs://hive-dataproc-generated-bucket/hive-warehouseDetermines the S3 path or storage location for Iceberg data. The value "s3a://warehouse/" represents the designated S3 bucket or directory. If using GCP, use dataproc hive metastore bucket.
AWS Regionus-east-1Specifies the AWS region associated with the S3 bucket where the data is stored.
AWS Access KeyadminProvides the AWS access key used for authentication when connecting to S3.
AWS Secret KeypasswordProvides the AWS secret key used for authentication when connecting to S3.
S3 Endpointhttp://localhost:9000Specifies the endpoint URL for the S3 service. This may be used when connecting to an S3-compatible storage service like MinIO running on localhost.
Hive URIthrift://localhost:9083 or thrift://METASTORE_IP:9083Defines the URI of the Hive Metastore service that the writer will connect to for catalog interactions. METASTORE_IP will be provided by GCP's Hive dataproc metastore.
Use SSL for S3falseIndicates whether SSL is enabled for S3 connections. "false" means that SSL is disabled for these communications.
Use Path Style for S3trueDetermines if path-style access is used for S3. "true" means that the writer will use path-style addressing instead of the default virtual-hosted style.
Hive Clients5Specifies the number of Hive clients allocated for managing interactions with the Hive Metastore.
Enable SASL for HivefalseIndicates whether SASL authentication is enabled for the Hive connection. "false" means that SASL is disabled.
Iceberg Databaseolake_icebergSpecifies the name of the Iceberg database to be used by the destination configuration.

Need Assistance?

If you have any questions or uncertainties about setting up OLake, contributing to the project, or troubleshooting any issues, we’re here to help. You can:

  • Email Support: Reach out to our team at hello@olake.io for prompt assistance.
  • Join our Slack Community: where we discuss future roadmaps, discuss bugs, help folks to debug issues they are facing and more.
  • Schedule a Call: If you prefer a one-on-one conversation, schedule a call with our CTO and team.

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!