Field	Description	Example Value	Type
bucket_name required	S3 bucket name where Iceberg table data and metadata files will be stored.	"my-data-warehouse"	String
region required	AWS Region where your S3 bucket exists. Required so OLake Go calls the correct regional S3 endpoint.	"us-east-1"	String
path_prefix	Optional path prefix to filter files	"data"	String
access_key_id	AWS access key ID for authentication. Optional if using IAM roles or instance profiles.	"<YOUR_KEY>"	String
secret_access_key	AWS secret access key for authentication. Optional if using IAM roles or instance profiles.	"<YOUR_SECRET>"	String
endpoint	Custom S3 endpoint for MinIO/LocalStack (required for non-AWS)	"http://localhost:9000"	String
file_format required	Select the format of files in the bucket to sync. OLake Go uses this to determine how to read and process files during sync.	Parquet XML JSON CSV	String
max_threads	Maximum number of worker threads the connector can spin up for parallel tasks.	10	Integer
retry_count	Number of retry attempts for failures.	3	Integer
compression	Compression format of the files.	none gzip zip	String
file_pattern	Regular expression to filter files by name.	.*\.csv$	String