Skip to main content

RSS

Availability
Available CoreAvailable StandardAvailable PlusAvailable ProAvailable Enterprise FlexAvailable PyAirbyte
Connector type
Available Data replicationNot available Agent(learn more)
Support Level
Marketplace
Connector Version
1.0.31 (last updated 2 years ago)
CDK Version
0.88.1
Sync Success Rate
High
Usage Rate
High
Data workers used
0.2 per sync (Learn more)
Definition ID
0efee448-6948-49e2-b786-17db50647908

Overview​

The RSS source allows you to read data from any individual RSS feed.

Output schema​

This source is capable of syncing the following streams:

  • items
    • Provides stats about specific RSS items.
    • Supports RSS 2.0, RSS 1.0 (RDF), and Atom feeds.
    • Most fields are kept from feed items as strings if present (title, link, description, author, category, comments, enclosure, guid). Relative links are resolved against the feed URL, enclosure holds the enclosure URL, and description contains the HTML exactly as the feed publishes it, without sanitization.
    • The date field is handled differently. It's transformed into a UTC datetime in a published field for easier use in data warehouses and other destinations. The connector reads it from pubDate, published or issued (RSS, in any capitalization), atom:published, dcterms:issued, published or updated (Atom), or dc:date. Dates are converted using their time zone, including offsets like -05:00 or GMT+0530 and US zone abbreviations like PT.
    • Items without a parseable date are skipped instead of failing the sync. Items dated in the future are held back until that date passes.
    • The connector requests the feed URL exactly as you enter it. If the response isn't an RSS, RDF or Atom feed, or can't be parsed as XML after the connector repairs common errors, the sync reads zero records and logs a warning, and the connection check still passes.
    • Since guid is not a required field, there is no primary key for the feed, only a cursor on the published date.

Features​

FeatureSupported?
Full Refresh SyncYes
Incremental - Append SyncYes
NamespacesNo

Requirements / Setup Guide​

Only the url of an RSS feed is required.

Performance considerations​

None

IP allow list​

If you use Airbyte Cloud and your organization restricts access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.

Reference​

Config fields reference

Field
Type
Property name
string
url

Changelog​

Expand to review
VersionDatePull RequestSubject
1.1.02026-11-0991337Migrate to manifest-only. The connector now requests the feed URL exactly as configured (no trailing slash is appended), emits description HTML unsanitized, populates enclosure, resolves relative links, syncs Atom, RDF and RSS 2.0 items dated only by updated or dc:date, skips items without a parseable date instead of failing the sync, and holds back items dated in the future until that date passes
1.0.312025-02-0151897Update dependencies
1.0.302025-01-1151334Update dependencies
1.0.292025-01-0450935Update dependencies
1.0.282024-12-2850731Update dependencies
1.0.272024-12-2150296Update dependencies
1.0.262024-12-1449699Update dependencies
1.0.252024-12-1149082Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64
1.0.242024-11-0448252Update dependencies
1.0.232024-10-2947104Update dependencies
1.0.222024-10-1246793Update dependencies
1.0.212024-10-0546454Update dependencies
1.0.202024-09-2846185Update dependencies
1.0.192024-09-2145812Update dependencies
1.0.182024-09-1445538Update dependencies
1.0.172024-09-0745223Update dependencies
1.0.162024-08-3145058Update dependencies
1.0.152024-08-2444635Update dependencies
1.0.142024-08-1744257Update dependencies
1.0.132024-08-1243883Update dependencies
1.0.122024-08-1043687Update dependencies
1.0.112024-08-0343073Update dependencies
1.0.102024-07-2742687Update dependencies
1.0.92024-07-2042139Update dependencies
1.0.82024-07-1341741Update dependencies
1.0.72024-07-1041570Update dependencies
1.0.62024-07-0941197Update dependencies
1.0.52024-07-0640921Update dependencies
1.0.42024-06-2540410Update dependencies
1.0.32024-06-2240083Update dependencies
1.0.22024-06-0439085[autopull] Upgrade base image to v1.2.1
1.0.12024-04-3037535Fix incremental sync
1.0.02024-04-2036418Migrate python cdk to low code
0.1.02022-10-1218838Initial release supporting RSS
Was this page helpful?