Parquet local writer

info

Please read the getting started instructions before proceeding with this section.

Sample Configuration

writer.json

{
  "type": "PARQUET",
  "writer": {
    "normalization": false,
    "local_path": "./mnt/config"
  }
}

Configuration Key Details

Key	Data Type	Example Value	Description & Possible Values
type	string	"PARQUET"	Specifies the output file format. Currently, only the Parquet format is supported.
writer.normalization	boolean	false	Determines whether OLake applies level-1 JSON flattening to nested objects. Set to true if you require normalized output; otherwise, use false.
writer.local_path	string	"/mnt/config"	The local directory inside the Docker container where Parquet files will be stored. This path is mapped to your host file system via a Docker volume.

Note: This configuration enables the Parquet local writer. For more details, check out the README section.

Data Partitioning

Refer to S3 docs for more details.