ClickHouse v2
A fresh implementation of ClickHouse leveraging our new CDK.
Improvements over v1
- All sync modes supported
- Data will be typed and written to columns matching the defined schema (Direct Load)
- Performance improvements
- Actively maintained and developed by Airbyte
Features
All sync modes are supported.
| Feature | Supported?(Yes/No) | Notes |
|---|---|---|
| Full Refresh Sync | Yes | |
| Incremental - Append Sync | Yes | |
| Incremental - Append + Deduped | Yes | Leverages ReplacingMergeTree |
| Namespaces | Yes |
Output Schema
Each stream will be output into its own table in ClickHouse in either the configured default database (default) or a database corresponding to the specified namespace on the stream.
Airbyte types will be converted as follows:
BooleanType -> Bool DateType -> Date32 IntegerType -> Int64 NumberType (float) -> DECIMAL128(9) StringType -> String TimeTypeWithTimezone -> String TimeTypeWithoutTimezone -> String TimestampTypeWithTimezone -> DateTime64(3) TimestampTypeWithoutTimezone -> DateTime64(3) Other Misc. -> String
Requirements
To use the ClickHouse destination, you'll need:
- A cloud ClickHouse instance
- A ClickHouse server version 21.8.10.19 or above
Configure Network Access
Make sure your ClickHouse database can be accessed by Airbyte. If your database is within a VPC, you may need to allow access from the IP you're using to expose Airbyte.
Permissions
You need a ClickHouse user with the following permissions:
- can create tables and write rows.
- can create databases e.g:
You can create such a user by running:
GRANT CREATE ON * TO airbyte_user;
GRANT CREATE ON {your configured default database} * TO airbyte_user;
GRANT DROP ON * TO airbyte_user;
GRANT TRUNCATE ON * TO airbyte_user;
GRANT INSERT ON * TO airbyte_user;
GRANT SELECT ON * TO airbyte_user;
GRANT CREATE DATABASE ON airbyte_internal.* TO airbyte_user;
GRANT CREATE TABLE ON airbyte_internal.* TO airbyte_user;
GRANT DROP ON airbyte_internal.* TO airbyte_user;
GRANT TRUNCATE ON airbyte_internal.* TO airbyte_user;
GRANT INSERT ON airbyte_internal.* TO airbyte_user;
GRANT SELECT ON airbyte_internal.* TO airbyte_user;
You can also use a pre-existing user but we highly recommend creating a dedicated user for Airbyte.
Reference
Config fields reference
Changelog
Expand to review
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 0.1.6 | 2025-06-24 | #62047 | Hide protocol option when running on cloud. |
| 0.1.5 | 2025-06-24 | #62043 | Expose database protocol config option. |
| 0.1.4 | 2025-06-24 | #62040 | Checker inserts into configured DB. |
| 0.1.3 | 2025-06-24 | #62038 | Allow the client to connect to the resolved DB. |
| 0.1.2 | 2025-06-23 | #62028 | Enable the registry in OSS and cloud. |
| 0.1.1 | 2025-06-23 | #62022 | Publish first beta version and pin the CDK version. |
| 0.1.0 | 2025-06-23 | #62024 | Release first beta version. |