Skip to main content
KeyDescriptionData TypeProbable Values
S3 BucketThe name of the Amazon/Google S3 bucket (without s3:// or gs://) where your output files will be stored. Ensure that the bucket exists and that you have proper access.stringA valid S3 bucket name (e.g. "olake-s3-test")
S3 RegionThe AWS/MinIO/GCS region where the specified S3 bucket is hosted.stringAWS/GCS region codes such as "ap-south-1", "us-west-2", etc.
S3 Access KeyThe AWS/MinIO/GCS HMAC access key used for authenticating S3 requests.stringA valid AWS/GCS HMAC access key
S3 Secret KeyThe AWS/MinIO/GCS HMAC secret key used for S3 authentication. This key should be kept secure.stringA valid AWS/GCS HMAC secret key
S3 PathThe specific path (or prefix) within the S3 bucket where data files will be written. This is typically a folder path that starts with a / (e.g. "/data").stringA valid path string
S3 Endpoint(Optional) Custom S3-compatible endpoint. Required when using GCS HMAC keys or MinIO S3.string"https://storage.googleapis.com", "https://<MinIO-Storage-Endpoint>:9000"
Max File Size (MB)(Optional) Rolls a partition into a new parquet file once the current file reaches this size in MB. Fractional values are allowed. Defaults to 512 when unset.numberA positive number (integers e.g. 512, 128 or fractional e.g. 0.1 for 100KB)


💡 Join the OLake Community!

Got questions, ideas, or just want to connect with other data engineers?
👉 Join our Slack Community to get real-time support, share feedback, and shape the future of OLake together. 🚀

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!