Google Analytics

Features

Feature
Supported?
Full Refresh Sync
Yes
Incremental Sync
Yes
Replicate Incremental Deletes
No
SSL connection
Yes
Custom Reports
Yes

Supported Tables

This source is capable of syncing the following tables and their data:
  • website_overview
  • traffic_sources
  • pages
  • locations
  • monthly_active_users
  • four_weekly_active_users
  • two_weekly_active_users
  • weekly_active_users
  • daily_active_users
  • devices
  • Any custom reports. See below for details.
Please reach out to us on Slack or create an issue if you need to send custom Google Analytics report data with Airbyte.

Getting Started (Airbyte Cloud)

  1. 1.
    Click OAuth2.0 authorization then Authenticate your Google Analytics account.
  2. 2.
    Find your View ID for the view you want to fetch data from. Find it here.
  3. 3.
    Enter a start date, and custom report information.
  4. 4.
    You're done.

Getting Started (Airbyte Open-Source)

There are 2 options of setting up authorization for this source:
  • Create service account specifically for Airbyte and authorize with JWT. Select "JWT authorization" from the "Authentication mechanism" dropdown list.
  • Use your Google account and authorize over Google's OAuth on connection setup. Select "Default OAuth2.0 authorization" from dropdown list.

Create a Service Account

First, need to select or create a project in the Google Developers Console:
  1. 1.
    Sign in to the Google Account you are using for Google Analytics as an admin.
  2. 3.
    Click Create service account.
  3. 4.
    Create a JSON key file for the service user. The contents of this file will be provided as the credentials_json in the UI when authorizing GA after you grant permissions (see below).

Add service account to the Google Analytics account

Use the service account email address to add a user to the Google analytics view you want to access via the API. You will need to grant Read & Analyze permissions.

Enable the APIs

  1. 1.
    Go to the Google Analytics Reporting API dashboard in the project for your service user. Enable the API for your account. You can set quotas and check usage.
  2. 2.
    Go to the Google Analytics API dashboard in the project for your service user. Enable the API for your account.

Reading Custom Reports

You can replicate Google Analytics Custom Reports using this source. To do this, input a JSON object as a string in the "Custom Reports" field when setting up the connector. The JSON is an array of objects where each object has the following schema:
1
{"name": string, "dimensions": [string], "metrics": [string]}
Copied!
Here is an example input "Custom Reports" field:
1
[{"name": "new_users_per_day", "dimensions": ["ga:date","ga:country","ga:region"], "metrics": ["ga:newUsers"]}, {"name": "users_per_city", "dimensions": ["ga:city"], "metrics": ["ga:users"]}]
Copied!
To create a list of dimensions, you can use default GA dimensions (listed below) or custom dimensions if you have some defined. Each report can contain no more than 7 dimensions, and they must all be unique. The default GA dimensions are:
  • ga:browser
  • ga:city
  • ga:continent
  • ga:country
  • ga:date
  • ga:deviceCategory
  • ga:hostname
  • ga:medium
  • ga:metro
  • ga:operatingSystem
  • ga:pagePath
  • ga:region
  • ga:socialNetwork
  • ga:source
  • ga:subContinent
To create a list of metrics, use a default GA metric (values from the list below) or custom metrics if you have defined them. A custom report can contain no more than 10 unique metrics. The default available GA metrics are:
  • ga:14dayUsers
  • ga:1dayUsers
  • ga:28dayUsers
  • ga:30dayUsers
  • ga:7dayUsers
  • ga:avgSessionDuration
  • ga:avgTimeOnPage
  • ga:bounceRate
  • ga:entranceRate
  • ga:entrances
  • ga:exitRate
  • ga:exits
  • ga:newUsers
  • ga:pageviews
  • ga:pageviewsPerSession
  • ga:sessions
  • ga:sessionsPerUser
  • ga:uniquePageviews
  • ga:users
Incremental sync supports only if you add ga:date dimension to your custom report.

Rate Limits & Performance Considerations (Airbyte Open-Source)

  • Number of requests per day per project: 50,000
  • Number of requests per view (profile) per day: 10,000 (cannot be increased)
  • Number of requests per 100 seconds per project: 2,000
  • Number of requests per 100 seconds per user per project: 100 (can be increased in Google API Console to 1,000).
The Google Analytics connector should not run into Google Analytics API limitations under normal usage. Please create an issue if you see any rate limit issues that are not automatically retried successfully.

Changelog

Version
Date
Pull Request
Subject
0.1.15
2021-12-28
9165
Update titles and descriptions
0.1.14
2021-12-09
8656
Fix date-format in schemas
0.1.13
2021-12-09
8676
Fix window_in_days validation issue
0.1.12
2021-12-03
8175
Fix validation of unknown metric(s) or dimension(s) error
0.1.11
2021-11-30
8264
Corrected date range
0.1.10
2021-11-19
8087
Support start_date before the account has any data
0.1.9
2021-10-27
7410
Add check for correct permission for requested view_id
0.1.8
2021-10-13
7020
Add intermediary auth config support
0.1.7
2021-10-07
6414
Declare oauth parameters in google sources
0.1.6
2021-09-27
6459
Update OAuth Spec File
0.1.3
2021-09-21
6357
Fix oauth workflow parameters
0.1.2
2021-09-20
6306
Support of airbyte OAuth initialization flow
0.1.1
2021-08-25
5655
Corrected validation of empty custom report
0.1.0
2021-08-10
5290
Initial Release
Last modified 5h ago