Last updated:|... min read
| Parameter | Sample Value | Description |
|---|---|---|
S3 Path required | gs://hive-dataproc-generated-bucket/hive-warehouse or s3://<BUCKET_NAME>/ | S3 bucket path where Iceberg table data and metadata files will be stored. |
AWS Region required | us-east-1 | AWS Region where your S3 bucket exist. Required so OLake Go calls the correct regional S3 endpoints. |
Hive Clients required | 5 | Specifies the number of Hive clients allocated for managing interactions with the Hive Metastore. |
Hive URI required | thrift://<hostname>:9083 or thrift://METASTORE_IP:9083 | Thrift endpoint URL for your Hive Metastore service. OLake Go uses this to read and write Iceberg catalog metadata. |
| AWS Access Key | XXX | AWS access key ID for authentication. Optional if using IAM roles or instance profiles. If using IAM: Docker Compose: add the required IAM environment variables under x-envs in your compose file. See Service Environment Variables for setup details.Kubernetes: set up pod IAM in Cloud IAM Integration. |
| AWS Secret Key | XXX | AWS secret access key for authentication. Optional if using IAM roles or instance profiles. If using IAM: Docker Compose: add the required IAM environment variables under x-envs in your compose file. See Service Environment Variables for setup details.Kubernetes: set up pod IAM in Cloud IAM Integration. |
| S3 Endpoint | https://glue.ap-south-1.amazonaws.com | S3 API endpoint for writing Iceberg data files. Optional for AWS S3 but required for S3-compatible storage like MinIO. |
| Catalog Name | olake_iceberg | Name of the Iceberg catalog OLake Go registers tables under. Defaults to olake_iceberg if left empty. |
| Use SSL for S3 | false/true | Controls whether OLake Go uses HTTPS when connecting to the S3 API for writing Iceberg files. Set to false when S3 Endpoint uses http:// (for example, local MinIO). Set to true when the endpoint uses https:// (for example, AWS S3 or TLS-enabled MinIO). |
| Use Path Style for S3 | false/true | Controls how OLake Go formats S3 request URLs. Path-style puts the bucket name in the URL path instead of the hostname. This is required for MinIO and other S3-compatible storage that do not support AWS-style virtual-hosted URLs. |
| Enable SASL for Hive | false/true | Enables SASL authentication when OLake Go connects to the Hive Metastore over Thrift. Required only if your metastore enforces SASL-based client authentication. |
| Enable Arrow Writes | false/true | Writes data and delete files using Apache Arrow based writer and registers them in Iceberg. |