Integrating with Google BigQuery

To integrate BigQuery with your eSputnik account:

1. Register your account at Google Cloud Platform.
2. Get a project key.
3. Create tables in Google BigQuery for importing data to eSputnik; tables with data from eSputnik will be created automatically after the first export.

❗️

Important

When creating tables in Google BigQuery, use snake_case or camelCase for field names. This will help avoid spaces in names and simplify integration with eSputnik.

Examples of correct names:

• first_name
• loyalty_card_number
• orderDate

4. Create the eSputnik connector.

If you already have a project key and BigQuery tables with data for eSputnik, you can go directly to the connector settings.

Creating a Project Key

1. Create a Google Cloud Platform account.
2. Select a project → APIs & Services → Credentials.

3. Click Create credentials → Service account.

4. Enter a service account name and click the Create and continue button.

5. Grant the service account the BigQuery Job User role at the project level, then click Continue → Done.

6. Create the dataset that the connector will work with, and grant the same service account the BigQuery Data Owner role on that dataset only.

📘

Least-privilege access

The connector needs two permissions: running queries in the project and creating and managing tables inside one dataset. Granting BigQuery Job User at the project level and BigQuery Data Owner on a single dataset covers both without giving the service account access to the rest of your BigQuery data. Project-wide BigQuery Admin is not required.

7. Click the link Manage service accounts on the main page of the Credentials section.

8. Click on the three dots opposite the created account and select the option Manage keys.

9. Click on the Add key button and select the Create new key option in the Keys section.

10. Select JSON key type and click Create.

The browser will automatically download the key to the download folder.

Connecting BigQuery

Go to your profile → Settings → Connectors → and select Connect BigQuery.

Create connector:

1. Fill in the Name field.
2. Upload the key file.
3. Click Validate connection to test whether the authorization data is correct. You will see a notification if the connection is successful or not. If the connection fails, check the entered data and contact your system administrator if needed.
4. Set unique contact field: select a table column that contains a unique contact key and eSputnik's unique contact key. They should match.
5. Click Save.

The created connector will be displayed in the Settings → Connectors section. Click the tab with its name to edit the connector’s parameters.

Now, you can use it for exporting eSputnik’s data and for importing data from BigQuery.

📘

Note

• The target BigQuery dataset must already exist before you connect it — eSputnik creates the individual tables inside that dataset automatically, but it does not create the dataset itself.
• The first export includes the history the account already holds, so you don't have to request a separate upload of earlier data. The limit is what the account collected: contact activity goes back up to 90 days and no earlier than the day activity collection was enabled, while the other data sets cover the whole lifetime of the account. Activity from before collection was enabled can't be recovered by any means, including the Get contacts activity API resource.