Skip to main content
source.json - JSON Format
{
"bucket_name": "source-data",
"region": "us-east-1",
"path_prefix": "json/",
"access_key_id": "minioadmin",
"secret_access_key": "minioadmin",
"endpoint": "http://localhost:9000",
"file_format": "json",
"max_threads": 5,
"retry_count": 3,
"json": {
"line_delimited": true
}
}

JSON Configuration Fields:

FieldDescriptionDefault
line_delimitedUse line-delimited JSON (JSONL) format instead of JSON arraytrue

Supported JSON Formats:

  • JSONL: {"id": 1}\n{"id": 2}\n
  • JSON Array: [{"id": 1}, {"id": 2}]
  • Single Object: {"data": [...]}

Format is auto-detected if line_delimited is not specified.

Note: Gzip compression is automatically detected for .json.gz and .jsonl.gz files.



💡 Join the OLake Community!

Got questions, ideas, or just want to connect with other data engineers?
👉 Join our Slack Community to get real-time support, share feedback, and shape the future of OLake together. 🚀

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!