Last updated:|... min read
| Parameter | Sample Value | Description |
|---|---|---|
iceberg_s3_path required | s3://warehouse/ or gs://hive-dataproc-generated-bucket/hive-warehouse | S3 bucket path where Iceberg table data and metadata files will be stored. |
aws_region required | us-east-1 | AWS Region where your S3 bucket exist. Required so OLake Go calls the correct regional S3 endpoints. |
hive_uri required | thrift://<hostname>:9083 or thrift://METASTORE_IP:9083 | Thrift endpoint URL for your Hive Metastore service. OLake Go uses this to read and write Iceberg catalog metadata. |
hive_clients required | 5 | Specifies the number of Hive clients allocated for managing interactions with the Hive Metastore. |
| aws_access_key | XXX | AWS access key ID for authentication. Optional if using IAM roles or instance profiles. If using IAM: Docker Compose: add the required IAM environment variables under x-envs in your compose file. See Service Environment Variables for setup details.Kubernetes: set up pod IAM in Cloud IAM Integration. |
| aws_secret_key | XXX | AWS secret access key for authentication. Optional if using IAM roles or instance profiles. If using IAM: Docker Compose: add the required IAM environment variables under x-envs in your compose file. See Service Environment Variables for setup details.Kubernetes: set up pod IAM in Cloud IAM Integration. |
| s3_endpoint | http://S3_ENDPOINT | S3 API endpoint for writing Iceberg data files. Optional for AWS S3 but required for S3-compatible storage like MinIO. |
| catalog_name | olake_iceberg | Name of the Iceberg catalog OLake Go registers tables under. Defaults to olake_iceberg if left empty. |
| s3_use_ssl | false/true | Controls whether OLake Go uses HTTPS when connecting to the S3 API for writing Iceberg files. Set to false when S3 Endpoint uses http:// (for example, local MinIO). Set to true when the endpoint uses https:// (for example, AWS S3 or TLS-enabled MinIO). |
| s3_path_style | false/true | Controls how OLake Go formats S3 request URLs. Path-style puts the bucket name in the URL path instead of the hostname. This is required for MinIO and other S3-compatible storage that do not support AWS-style virtual-hosted URLs. |
| hive_sasl_enabled | false/true | Enables SASL authentication when OLake Go connects to the Hive Metastore over Thrift. Required only if your metastore enforces SASL-based client authentication. |
| arrow_writes | false/true | Writes data and delete files using Apache Arrow based writer and registers them in Iceberg. |