Skip to main content
source.json - CSV Format
{
"bucket_name": "source-data",
"region": "us-east-1",
"path_prefix": "csv/",
"access_key_id": "minioadmin",
"secret_access_key": "minioadmin",
"endpoint": "http://localhost:9000",
"file_format": "csv",
"max_threads": 5,
"retry_count": 3,
"csv": {
"has_header": true,
"delimiter": ",",
"skip_rows": 0,
"quote_character": "\""
}
}

CSV Configuration Fields:

FieldDescriptionDefaultExample
delimiterField separator character","";" or "\\t"
has_headerWhether first row contains column namestruefalse
skip_rowsNumber of rows to skip at beginning02
quote_characterCharacter for quoting fields"\"""'"

Note: Gzip compression is automatically detected for .csv.gz files.



πŸ’‘ Join the OLake Community!

Got questions, ideas, or just want to connect with other data engineers?
πŸ‘‰ Join our Slack Community to get real-time support, share feedback, and shape the future of OLake together. πŸš€

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!