Our Connector Development Kit
Published May 12, 2021.
Here are the community news and product updates of the past week.
Airbyte's Connector Development Kit (CDK) is out!
The CDK removes 75% of the code needed to build a new connector, all the repeated logic and incidental complexities. Build new connectors for Rest API sources within 2 hours.
Our progress in April: MySQL, Iterable, Quickbooks, Zoho, Smartsheets...
New destinations: MySQL (MSSQL and S3 are coming soon!). New sources: Quickbooks, Iterable, Zendesk Chat and Talk, Appsflyer,... We also made support for larger data sets more mature: better state management, throughput & reliability...
How User Success Helps Us Become the Most Active Slack Community
This article describes how Airbyte's Slack community grew to 1,000 users and 115,000 messages in just 7 months, with a focus on user success.
A Talk We Gave To KubeCon: How Airbyte Leverages Kubernetes
Kubernetes enables an infrastructural shift in making our architecture flexible, composable, and scalable, allowing us to explore a variety of futures for what the ideal Airbyte deployment could look like.
Community Highlights
2nd Community Call with AgriDigital's approach to caching strategies with Airbyte
In May's community call, we shared our progress of the past month and the roadmap for May. Jins (CTO of AgriDigital) also shared with us how his team leverages Airbyte for his caching strategies, a very interesting approach.
Commoditizing data integration alongside Airbyte
Nathan Nowack shares his experience on building a connector using Airbyte's first version of the CDK.
Which Open-source Data Integration Tool Is Right for Your Project?
A great article by our friends at Preset comparing Airbyte to Meltano. In the end, the Preset team ended up using Airbyte for its ease of use, containerized architecture, and velocity.
Why we sold intermix.io to private equity in a shifting market
This very interesting article relates the history of Intermix.io, but also of Snowflake and the reasons for its growth. An awesome read with a lot of gold nuggets on the forces that drives the data infrastructure industry.
What Skills Does a Data Engineer Need?
A great article by @SeattleDataGuy on the skills needed by data engineers. From Python/SQL as foundational skills, to ETL/ELT, data viz, distributed processing, and more!