Skip to main content
source.json - JSON Format
{
"bucket_name": "source-data",
"region": "us-east-1",
"path_prefix": "json/",
"access_key_id": "minioadmin",
"secret_access_key": "minioadmin",
"endpoint": "http://localhost:9000",
"file_format": "json",
"max_threads": 5,
"retry_count": 3,
"json": {
"line_delimited": true
}
}

JSON Configuration Fields:

FieldDescriptionDefault
line_delimitedWhether JSON is JSONL (newline-delimited) formattrue

Supported JSON Formats:

  • JSONL: {"id": 1}\n{"id": 2}\n
  • JSON Array: [{"id": 1}, {"id": 2}]
  • Single Object: {"data": [...]}

Format is auto-detected if line_delimited is not specified.

Note: Gzip compression is automatically detected for .json.gz and .jsonl.gz files.



πŸ’‘ Join the OLake Community!

Got questions, ideas, or just want to connect with other data engineers?
πŸ‘‰ Join our Slack Community to get real-time support, share feedback, and shape the future of OLake together. πŸš€

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!