Last updated:|... min read
REST Configuration Parametersβ
Parameter | Sample Value | Description |
---|---|---|
REST Catalog URL | http://<REST_ENDPOINT>:8181 | Specifies the endpoint URL for the REST catalog service that the writer will connect to. |
Iceberg S3 Path | s3://<BUCKET_NAME> | Determines the S3 path or storage location for Iceberg data. "warehouse" represents the designated storage directory. |
Iceberg Database | <DATABASE_NAME> | Specifies the name of the Iceberg database that will be used by the destination configuration. |
S3 Endpoint | http://<S3_ENDPOINT>:9000 | Endpoint for the S3 service. |
AWS Region | <S3_REGION> | Specifies the AWS region associated with the S3 bucket where the data is stored. |
AWS Access Key | <S3_ACCESS_KEY> | AWS access key (Optional). |
AWS Secret Key | <S3_SECRET_KEY> | AWS secret key (Optional). |
Authentication Fields (optional)β
Parameter | Sample Value | Description |
---|---|---|
Token | abc...xyz | Specifies the Bearer token sent in the Authorization header for authenticating with the REST catalog service. |
OAuth2 Auth URI | https://auth.server.com/oauth/token | OAuth2 server URI for OAuth2 authentication. |
REST Auth Type | oauth2 | Authentication type (e.g., "oauth2"). |
Credential (OAuth2) | your_id:your_secret | Specifies the client ID and secret for OAuth2, formatted as client_id:client_secret. |
Scope (OAuth2) | api.read api.write | OAuth2 scopes (space-separated). |
REST Signing Name | s3tables | Service name for AWS Signature V4 (e.g., "s3tables"). |
REST Signing Region | us-east-1 | Region for AWS Signature V4 signing. |
REST Enable Signature V4 | true | Enable AWS Signature V4 signing (boolean). |
Disable Identifier Tables | false | Needed to set true for Databricks Unity Catalog as it doesn't support identifier fields |