Configuration Fields

Parameter	Sample Value	Description
catalog_type	rest	Defines the catalog type used by the writer. "rest" means the writer interacts with a RESTful catalog service.
rest_catalog_url	http://<REST_ENDPOINT>:8181	Specifies the endpoint URL for the REST catalog service that the writer will connect to.
iceberg_s3_path	s3://<BUCKET_NAME>	Determines the S3 path or storage location for Iceberg data.
s3_endpoint	http://<S3_ENDPOINT>:9000	Endpoint for the S3 service (Minio in this case).
aws_region	<S3_REGION>	Specifies the AWS region associated with the S3 bucket where the data is stored.
aws_access_key	<S3_ACCESS_KEY>	AWS access key (Optional).
aws_secret_key	<S3_SECRET_KEY>	AWS secret key (Optional).
iceberg_db	<DATABASE_NAME>	Specifies the name of the Iceberg database that will be used by the destination configuration.

Authentication Fields (optional)

Parameter	Sample Value	Description
token	abc...xyz	Specifies the Bearer token sent in the Authorization header for authenticating with the REST catalog service.
oauth2_uri	https://auth.server.com/oauth/token	OAuth2 server URI for OAuth2 authentication.
rest_auth_type	oauth2	Authentication type (e.g., "oauth2").
credential	your_id:your_secret	Specifies the client ID and secret for OAuth2, formatted as client_id:client_secret.
scope	api.read api.write	OAuth2 scopes (space-separated).
rest_signing_name	s3tables	Service name for AWS Signature V4 (e.g., "s3tables").
rest_signing_region	us-east-1	Region for AWS Signature V4 signing.
rest_signing_v_4	true	Enable AWS Signature V4 signing (boolean).
no_identifier_fields	false	Needed to set true for Databricks Unity Catalog as it doesn't support identifier fields