Last updated:|... min read
source.json - Parquet Format
{
"bucket_name": "source-data",
"region": "us-east-1",
"path_prefix": "parquet/",
"access_key_id": "minioadmin",
"secret_access_key": "minioadmin",
"endpoint": "http://localhost:9000",
"file_format": "parquet",
"max_threads": 5,
"retry_count": 3
}
Parquet Features:
- Schema automatically read from Parquet file metadata
- No additional configuration required
- Supports all Parquet data types
- Efficient streaming for large files using S3 range requests
- Native columnar reading preserves type information