source.json - Parquet Format

{
  "bucket_name": "source-data",
  "region": "us-east-1",
  "path_prefix": "parquet/",
  "access_key_id": "minioadmin",
  "secret_access_key": "minioadmin",
  "endpoint": "http://localhost:9000",
  "file_format": "parquet",
  "max_threads": 5,
  "retry_count": 3
}

Parquet Configuration Fields:

Field	Description	Default
streaming_enabled	Use S3 range requests for memory-efficient streaming (recommended for large files)	true

Parquet Features:

• Schema automatically read from Parquet file metadata
• No additional configuration required
• Supports all Parquet data types
• Efficient streaming for large files using S3 range requests
• Native columnar reading preserves type information