Skip to main content

GitLab

Overview

The Gitlab source supports both Full Refresh and Incremental syncs. You can choose if this connector will copy only the new or updated data, or all rows in the tables and columns you set up for replication, every time a sync is run.

Output schema

This connector outputs the following streams:

Features

FeatureSupported?
Full Refresh SyncYes
Incremental - Append SyncPartially (not all streams)
SSL connectionYes
NamespacesNo

Performance considerations

Gitlab has the rate limits, but the Gitlab connector should not run into Gitlab API limitations under normal usage. Please create an issue if you see any rate limit issues that are not automatically retried successfully.

Getting started

Requirements

  • Gitlab Account
  • Gitlab Personal Access Token wih the necessary permissions (described below)

Setup guide

Log into Gitlab and then generate a personal access token.

Your token should have the read_api scope, that Grants read access to the API, including all groups and projects, the container registry, and the package registry.

Note: You can specify either Group IDs or Project IDs in the source configuration. If both fields are blank, the connector will retrieve a list of all the groups that are accessible to the configured token and ingest as normal.

Additional information

GitLab source is working with GitLab API v4. It can also work with self-hosted GitLab API v4.

Changelog

VersionDatePull RequestSubject
0.1.62022-06-2313252Add GroupIssueBoards stream
0.1.52022-05-0211907Fix null projects param and container_expiration_policy
0.1.42022-03-2311140Ingest All Accessible Groups if not Specified in Config
0.1.32021-12-218991Update connector fields title/description
0.1.22021-10-187108Allow all domains to be used as api_url
0.1.12021-10-126932Fix pattern field in spec file, remove unused fields from config files, use cache from CDK
0.1.02021-07-064174Initial Release