source.json - CSV Format

{
  "bucket_name": "source-data",
  "region": "us-east-1",
  "path_prefix": "csv/",
  "access_key_id": "minioadmin",
  "secret_access_key": "minioadmin",
  "endpoint": "http://localhost:9000",
  "file_format": "csv",
  "max_threads": 5,
  "retry_count": 3,
  "csv": {
    "has_header": true,
    "delimiter": ",",
    "skip_rows": 0,
    "quote_character": "\""
  }
}

CSV Configuration Fields:

Field	Description	Default
delimiter	Field separator character	","
has_header	Whether CSV files contain a header row	true
skip_rows	Number of rows to skip at the beginning of CSV files	0
quote_character	Quote character for CSV files	"\""

Note: Gzip compression is automatically detected for .csv.gz files.