Integrating with Google BigQuery

To integrate BigQuery with your eSputnik account:

  1. Register your account at Google Cloud Platform.
  2. Get a project key.
  3. Create tables in Google BigQuery for importing data to eSputnik; tables with data from eSputnik will be created automatically after the first export.
ā—ļø

Important

When creating tables in Google BigQuery, use snake_case or camelCase for field names. This will help avoid spaces in names and simplify integration with eSputnik.

Examples of correct names:

  • first_name
  • loyalty_card_number
  • orderDate
  1. Create the eSputnik connector.

If you already have a project key and BigQuery tables with data for eSputnik, you can go directly to the connector settings.

Creating a Project Key

  1. Create a Google Cloud Platform account.
  2. Select a project → APIs & Services → Credentials.
Google Cloud APIs & Services page with the project selector dropdown highlighted and Credentials selected in the sidebar
  1. Click Create credentials → Service account.
Create credentials dropdown menu on the Google Cloud Credentials page with the Service account option highlighted
  1. Enter a service account name and click the Create and continue button.
Create service account form with the Service account name field filled in and the Create and continue button highlighted
  1. Select BigQuery Admin role, click Continue → Done.
Grant service account access step with the Role field set to BigQuery Admin and the Done button highlighted
šŸ“˜

Note

BigQuery Admin is required because the connector needs to create and manage tables in your dataset — there's currently no narrower, custom-scoped role that supports this. If your security team requires least-privilege access, scope the role to the specific GCP project used for this integration rather than granting BigQuery Admin at the organization or account level.

  1. Click the link Manage service accounts on the main page of the Credentials section.
Google Cloud Credentials page with the Manage service accounts link highlighted
  1. Click on the three dots opposite the created account and select the option Manage keys.
Service accounts list with the account's options menu open and Manage keys highlighted
  1. Click on the Add key button and select the Create new key option in the Keys section.
Keys tab of a service account with the Add key dropdown open and Create new key highlighted
  1. Select JSON key type and click Create.
Create private key dialog with the JSON key type selected and the Create button highlighted

The browser will automatically download the key to the download folder.

Connecting BigQuery

Go to your profile → Settings → Connectors → and select Connect BigQuery.

Connect BigQuery

Create connector:

  1. Fill in the Name field.
  2. Upload the key file.
  3. Click Validate connection to test whether the authorization data is correct. You will see a notification if the connection is successful or not. If the connection fails, check the entered data and contact your system administrator if needed.
  4. Set unique contact field: select a table column that contains a unique contact key and eSputnik's unique contact key. They should match.
  5. Click Save.
Save

The created connector will be displayed in the Settings → Connectors section. Click the tab with its name to edit the connector’s parameters.

Connectors

Now, you can use it for exporting eSputnik’s data and for importing data from BigQuery.

šŸ“˜

Note

  • The target BigQuery dataset must already exist before you connect it — eSputnik creates the individual tables inside that dataset automatically, but it does not create the dataset itself.
  • The connector does not backfill historical data — export starts collecting data only from the moment the connector is activated. If you need data from before that date, request it via the Get contacts activity API method (available for roughly the last 3 months).

Did this page help you?