Surface the health of each connection so that a user can spot any problems at a glance.
Added support for deduplicating records in the destination using a primary key using incremental dedupe -
A source’s extraction mode (incremental, full refresh) is now decoupled from the destination’s write mode -- so you can repeatedly append full refreshes to get repeated snapshots of data in your source.
New Upgrade all button in Admin to upgrade all your connectors at once
New Cancel job button in Connections Status page when a sync job is running, so you can stop never-ending processes.
We made some progress to address nested tables in our normalization.
Previously, basic normalization would output nested tables as-is and append a number for duplicate tables. For example, Stripe’s nested address fields go from:
After the change, the parent tables are combined with the name of the nested table to show where the nested table originated. This is a breaking change for the consumers of nested tables. Consumers will need to update to point at the new tables.
It has been released for 15 connectors, including Postgres, MySQL, Intercom, Zendesk, Stripe, Twilio, Marketo, Shopify, GitHub, and all the destination connectors. We will expand it to all the connectors in the next couple of weeks.
Improve interface for writing python sources (should make writing new python sources easier and clearer).
Add support for running Standard Source Tests with files (making them easy to run for any language a source is written in)
Add ability to reset data for a connection.
Update version of test containers we use to avoid pull issues while running tests.
Fix issue where jobs were not sorted by created at in connection detail view.
New sources: Intercom, Mixpanel, Jira Cloud, Zoom, Drift, Microsoft Teams