Skip to main content

GlassFlow

Overview

The GlassFlow destination allows you to send/stream data to a GlassFlow pipeline. GlassFlow is a serverless, Python-centric data streaming platform that transforms data in real-time for end-to-end data pipelines.

Sync overview

Output schema

Each stream will be output a GlassFlow message. The message properties will be

  • stream: the name of stream where the data is coming from.
  • namespace: namespace if available from the stream.
  • emitted_at: timestamp the AirbyteRecord was emitted at.
  • data: AirbyteRecord data.

The message will be serialized as JSON.

Features

FeatureSupported?(Yes/No)Notes
Full Refresh SyncYes
Incremental - Append SyncYes
Incremental - Append + DedupedNo
NamespacesYes

Getting started

Requirements

To use the GlassFlow destination, you'll need:

  • A GlassFlow pipeline_id and pipeline_access_token to publish messages.

Reference

Config fields reference

Field
Type
Property name
string
pipeline_id
string
pipeline_access_token

Changelog

Expand to review
VersionDatePull RequestSubject
0.1.0September 01, 2024#7560Initial release