GlassFlow
Overview
The GlassFlow destination allows you to send/stream data to a GlassFlow pipeline. GlassFlow is a serverless, Python-centric data streaming platform that transforms data in real-time for end-to-end data pipelines.
Sync overview
Output schema
Each stream will be output a GlassFlow message. The message properties will be
stream
: the name of stream where the data is coming from.namespace
: namespace if available from the stream.emitted_at
: timestamp theAirbyteRecord
was emitted at.data
:AirbyteRecord
data.
The message will be serialized as JSON.
Features
Feature | Supported?(Yes/No) | Notes |
---|---|---|
Full Refresh Sync | Yes | |
Incremental - Append Sync | Yes | |
Incremental - Append + Deduped | No | |
Namespaces | Yes |
Getting started
Requirements
To use the GlassFlow destination, you'll need:
- A GlassFlow pipeline_id and pipeline_access_token to publish messages.
Reference
Config fields reference
Field
Type
Property name
string
pipeline_id
string
pipeline_access_token
Changelog
Expand to review
Version | Date | Pull Request | Subject |
---|---|---|---|
0.1.0 | September 01, 2024 | #7560 | Initial release |