Field	Description	Example Value	Type
bucket_name required	S3 bucket name (without s3:// prefix). Combined with path_prefix to form the full S3 path. Example: bucket_name="my-bucket", path_prefix="data/" results in s3://my-bucket/data/	"my-data-warehouse"	String
region required	AWS region where bucket is hosted	"us-east-1"	String
path_prefix	Optional path prefix to filter files (without leading/trailing slashes)	"data"	String
access_key_id	AWS access key ID (optional - see note below)	"<YOUR_KEY>"	String
secret_access_key	AWS secret access key (optional - see note below)	"<YOUR_SECRET>"	String
endpoint	Custom S3 endpoint for MinIO/LocalStack (required for non-AWS)	"http://localhost:9000"	String
file_format required	Format of files to sync: csv, json, or parquet	"parquet"	String
max_threads	Maximum number of concurrent file processors	10	Integer
retry_count	Number of retry attempts for failed operations	3	Integer
csv	CSV-specific configuration object (see CSV Format tab)	{"has_header": true, "delimiter": ","}	Object
json	JSON-specific configuration object (see JSON Format tab)	{"line_delimited": true}	Object

Authentication Note: Both access_key_id and secret_access_key are optional. If omitted, the driver uses AWS default credential chain (IAM roles, environment variables, instance profiles, ECS task roles, etc.). If you provide one, you must provide both.