Skip to main content

Configuring Table Compaction in Olake

Each table in Olake can have its own compaction schedule and advanced settings. Follow these steps to configure compaction for a specific table:

1. Click the Configure Button

Click the Configure button next to the table you want to compact. This opens a modal where you can schedule Lite, Medium, and Full compactions.

Configure button

2. Set the Compaction Schedule

  • Select a schedule from the predefined dropdown options or choose Custom to specify your own cron expression.
  • Compaction will run automatically according to the schedule set for that table.

Compaction Schedule

3. Advanced Config: Target File Size

  • Expand the Advanced Config panel in the modal.
  • Specify the Target File Size for the table (default 512 MB if you leave it unchanged).

For how target file size affects Lite, Medium, and Full compaction, see Types of Compaction Supported in OLake.

Tip: Choose a target size based on your query patterns and table size. Larger files can improve scan efficiency based on the query but may increase the cost of rewriting files.

Target File Size

4. Save the Configuration

  • Click Save.

Save Configuration

  • A dialog box confirms that the configuration was successful.

Save Configuration

5. Enable the Table for Compaction

  • After saving, you will be redirected to the Tables page.
  • Locate the table and toggle the Status switch to activate scheduled compaction for that specific table.

Important: The Status toggle must be switched on. Even if a cron schedule is configured, compaction will not execute unless the table is enabled.

Enable compaction



💡 Join the OLake Community!

Got questions, ideas, or just want to connect with other data engineers?
👉 Join our Slack Community to get real-time support, share feedback, and shape the future of OLake together. 🚀

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!