Skip to main content

Web Scrapper

Availability
Available CoreAvailable StandardAvailable PlusAvailable ProAvailable Enterprise FlexAvailable Self-Managed EnterpriseAvailable PyAirbyte
Support Level
Marketplace
Connector Version
0.0.52 (last updated 10 days ago)
Data workers used
0.2 per sync (Learn more)
Definition ID
2f87b960-0220-4b76-9ab3-fba67ca4c959

Web Scrapper connector enables data synchronization from Web Scrapper source to various data destination. It gives information about sitemaps, users, scraping jobs etc.

Configuration​

InputTypeDescriptionDefault Value
api_tokenstringAPI Token. API token to use. Find it at https://cloud.webscraper.io/api

Streams​

Stream NamePrimary KeyPaginationSupports Full SyncSupports Incremental
sitemap_listidDefaultPaginator✅❌
sitemap_detailidDefaultPaginator✅❌
usersNo pagination✅❌
scraping_jobsidDefaultPaginator✅❌
scraping_job_data_qualityNo pagination✅❌

IP allow list​

If you use Airbyte Cloud and your organization restricts access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.

Reference​

Config fields reference

Field
Type
Property name
string
api_token

Changelog​

Expand to review
VersionDatePull RequestSubject
0.0.532026-06-0979541Update dependencies
0.0.522026-06-0279047Update dependencies
0.0.512026-04-2877476Update dependencies
0.0.502026-04-2176787Update dependencies
0.0.492026-03-3175733Update dependencies
0.0.482026-03-2475060Update dependencies
0.0.472026-03-1074489Update dependencies
0.0.462026-02-2473445Update dependencies
0.0.452026-02-0372655Update dependencies
0.0.442026-01-2072095Update dependencies
0.0.432026-01-1471442Update dependencies
0.0.422025-12-1870731Update dependencies
0.0.412025-11-2570190Update dependencies
0.0.402025-11-1869700Update dependencies
0.0.392025-10-2968949Update dependencies
0.0.382025-10-2168387Update dependencies
0.0.372025-10-1467968Update dependencies
0.0.362025-10-0767331Update dependencies
0.0.352025-09-3066448Update dependencies
0.0.342025-09-0965727Update dependencies
0.0.332025-08-2465408Update dependencies
0.0.322025-08-1064855Update dependencies
0.0.312025-08-0264393Update dependencies
0.0.302025-07-2664050Update dependencies
0.0.292025-07-1963641Update dependencies
0.0.282025-07-1263235Update dependencies
0.0.272025-07-0562687Update dependencies
0.0.262025-06-2862204Update dependencies
0.0.252025-06-2161744Update dependencies
0.0.242025-06-1561195Update dependencies
0.0.232025-05-2459950Update dependencies
0.0.222025-05-0459544Update dependencies
0.0.212025-04-2658960Update dependencies
0.0.202025-04-1958538Update dependencies
0.0.192025-04-1258024Update dependencies
0.0.182025-04-0557418Update dependencies
0.0.172025-03-2956827Update dependencies
0.0.162025-03-2256322Update dependencies
0.0.152025-03-0855614Update dependencies
0.0.142025-03-0155086Update dependencies
0.0.132025-02-2254465Update dependencies
0.0.122025-02-1554038Update dependencies
0.0.112025-02-0853556Update dependencies
0.0.102025-02-0153102Update dependencies
0.0.92025-01-2552396Update dependencies
0.0.82025-01-1851429Update dependencies
0.0.72024-12-2850754Update dependencies
0.0.62024-12-2150370Update dependencies
0.0.52024-12-1449778Update dependencies
0.0.42024-12-1249393Update dependencies
0.0.32024-12-1149115Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64
0.0.22024-11-0448269Update dependencies
0.0.12024-10-29Initial release by @bishalbera via Connector Builder
Was this page helpful?