Sync Schedules

Cloud Self-Managed Community (OSS)Self-Managed Enterprise

For each connection, you can select between three options that allow a sync to run. The three options for Schedule Type are:

• Scheduled (e.g. every 24 hours, every 2 hours)
• Cron
• Manual

Sync Considerations

• Only one sync per connection can run at a time.
• If a sync is scheduled to run before the previous sync finishes, the scheduled sync will start after the completion of the previous sync.
• Syncs can run at most every 60 minutes in Airbyte Cloud. Reach out to Sales if you require replication more frequently than once per hour.

note

For Scheduled or cron scheduled syncs, Airbyte guarantees syncs will initiate with a schedule accuracy of +/- 30 minutes.

Scheduled syncs

You can choose between the following scheduled options:

• Every 24 hours (most common)
• Every 12 hours
• Every 8 hours
• Every 6 hours
• Every 3 hours
• Every 2 hours
• Every 1 hour

When a scheduled connection is first created, a sync is executed immediately after creation. After that, a sync is run once the time since the last sync (whether it was triggered manually or due to a schedule) has exceeded the schedule interval. For example:

• October 1st, 2pm, a user sets up a connection to sync data every 24 hours.
• October 1st, 2:01pm: sync job runs
• October 2nd, 2:01pm: 24 hours have passed since the last sync, so a sync is triggered.
• October 2nd, 5pm: The user manually triggers a sync from the UI
• October 3rd, 2:01pm: since the last sync was less than 24 hours ago, no sync is run
• October 3rd, 5:01pm: It has been more than 24 hours since the last sync, so a sync is run

Cron Syncs

If you prefer more precision in scheduling your sync, you can also use CRON scheduling to set a specific time of day or month.

Airbyte uses the CRON scheduler from Quartz. We recommend reading their documentation to understand the required formatting. You can also refer to these examples:

Cron string	Sync Timing
0 0 * * * ?	Every hour, at 0 minutes past the hour
0 0 15 * * ?	At 15:00 every day
0 0 15 * * MON,TUE	At 15:00, only on Monday and Tuesday
0 0 0,2,4,6 * * ?	At 12:00 AM, 02:00 AM, 04:00 AM and 06:00 AM every day
0 0 */15 * * ?	At 0 minutes past the hour, every 15 hours

When setting up the cron expression, you will also be asked to choose a time zone the sync will run in.

Manual Syncs

When the connection is set to replicate with Manual frequency, the sync will not automatically run.

It can be triggered by clicking the "Sync Now" button at any time through the UI or be triggered through the API.