Edit stream configuration
By editing stream configurations, you can customize how your data syncs to the destination. This allows you to manage aspects of the sync, such as replication frequency, destination namespace, and ensuring your data is written to the correct location.
On the Airbyte Cloud dashboard, click Connections and then click the connection you want to change.
Click the Replication tab.
The Transfer and Streams settings include the following parameters:
Parameter | Description |
---|---|
Replication frequency | How often the data syncs |
Non-breaking schema updates detected | How Airbyte handles syncs when it detects non-breaking schema changes in the source |
Destination Namespace | Where the replicated data is written |
Destination Stream Prefix | Helps you identify streams from different connectors |
These parameters apply to all streams in the connection.
If you need to use cron scheduling:
- In the Replication Frequency dropdown, click Cron.
- Enter a cron expression and choose a time zone to create a sync schedule.
- Only one sync per connection can run at a time.
- If cron schedules a sync to run before the last one finishes, the scheduled sync will start after the last sync completes.
- Airbyte Cloud does not allow schedules that sync more than once per hour.
In the Activate the streams you want to sync section, you can make changes to any stream you choose.
To search for a stream:
Click the Search stream name search box.
Type the name of the stream you want to find.
Streams matching your search are displayed in the list.
To change individual stream configuration:
In the Sync column of the stream, toggle the sync on or off.
Click the dropdown arrow in the Sync mode column and select the sync mode you want to apply.
Depending on the sync mode you select, you may need to choose a cursor or primary key.
- If there is a dropdown arrow in the Cursor or Primary key fields, click the dropdown arrow and choose the cursor or primary key.
To change multiple stream configurations:
Click the first checkbox in the table header to select all streams in the connection.
Deselect the checkboxes of streams you do not want to apply these changes to.
In the highlighted header of the table, toggle the sync on or off.
Click the dropdown arrow in the Sync mode column and select the sync mode you want to apply to these streams.
If there is a dropdown arrow in the Cursor or Primary key fields of the highlighted table header, click the dropdown arrow and choose the cursor or primary key.
Click Apply to apply these changes to the streams you selected, or click Cancel to discard the changes.
To save the changes:
Click Save changes, or click Cancel to discard the changes.
The Stream configuration changed dialog displays. This gives you the option to reset streams when you save the changes.
Airbyte recommends that you reset streams. A reset will delete data in the destination of the affected streams and then re-sync that data. Skipping a reset is discouraged and might lead to unexpected behavior.
- Click Save connection, or click Cancel to close the dialog.
To refresh the source schema:
Click Refresh source schema to fetch the schema of your data source.
If the schema has changed, the Refreshed source schema dialog displays them.