SFTP Bulk Migration Guide
Upgrading to 1.0.0
We're continuously striving to enhance the quality and reliability of our connectors at Airbyte.
As part of our commitment to delivering exceptional service, we are transitioning our SFTP Bulk source from the Python Connector Development Kit (CDK) to our new low-code framework improving maintainability and reliability of the connector. Due to differences between the Python and low-code CDKs, this migration constitutes a breaking change for the following:
- Changes to the source configuration
- Changes to the schema (added, removed fields and/or streams)
Migration Steps
This version change requires you to re-verify the configuration of your source. To do this, click on "Source" in the left-hand sidebar and navigate to your SFTP Bulk source. Test the source and ensure the configuration is valid before moving forward.
Clearing your data is required for the affected streams in order to continue syncing successfully. To clear your data for the affected streams, follow the steps below:
- Select Connections in the main navbar and select the connection(s) affected by the update.
- Select the Schema tab.
- Select Refresh source schema to bring in any schema changes. Any detected schema changes will be listed for your review.
- Select OK to approve changes.
- Select Save changes at the bottom of the page.
- Ensure the Clear affected streams option is checked to ensure your streams continue syncing successfully with the new schema.
- Select Save connection.
This will clear the data in your destination for the subset of streams with schema changes. After the clear succeeds, trigger a sync by clicking Sync Now. For more information on clearing your data in Airbyte, see this page.