Integrating with Google BigQuery

Step-by-step guide how to export data from eSputnik, your CRM, different databases to BigQuery. It allows you to manage and store all data, create multiple additional fields and custom reports, etc. in one place.

📘

Important

Please note that this integration is paid. Contact our sales team to activate the functionality

eSputnik provides two options for BigQuery integration:

• Exporting data from eSputnik to BigQuery
• Using data from BigQuery for segmentation and substitution of external data in messages.

To configure the BigQuery integration:

• Register at Google Cloud Platform
• Get a project key
• Create tables in Google BigQuery
• Configure two-sided BigQuery - eSputnik data transfer

If you already have a project key and have configured the BigQuery tables, you can go directly to the connector settings.

Creating a Project Key

1. Create a Google Cloud Platform account.

2. Select a project → APIs & Services → Credentials.

3. Click Create credentials → Service account.

4. Enter a service account name and click the Create and continue button.

5. Select BigQuery Admin role, click Continue → Done.

6. Click the link Manage service accounts on the main page of the Credentials section.

7. Click on the three dots opposite created account and select the option Manage keys.

8. Click on the Add key button and select Create new key option in Keys section.

9. Select JSON key type and click Create.

10. The browser will automatically download the key to the download folder.

Setting up BigQuery Connector

1. Go to your profile > Settings → Connectors → and select Connect BigQuerry.

2. Create connector:
   A. Fill in the Name field.
   B. Upload the key file.
   C. Click Validate connection to test whether the authorization data is correct. You will see the notification if the connection is successful or not. If the connection fails, check the entered data and contact your system administrator if needed.
   D. Set unique contact field: select a table column that contains a unique contact key and eSputnik's unique contact key. They should match.
   E. Click Save.

You will see created connector in Settings → Connectors. Click the tab with its name to edit the connector’s parameters.

Exporting Data to the BigQuery Table

To regularly update information about the audience, contacts' activity in widgets, orders and campaign results in BigQuery, set up data export to tables. For example, you can export responses to an NPS survey, purchase history, date of the last click in a message, etc.

Available datasets for export:

• broadcasts;
• contactActivities;
• contacts;
• devices;
• messages;
• orderItems;
• orders;
• revenue.

This information will be transferred to BigQuery and will update the data in the tables once a day after setting up.

📘

Important

You don’t need to pre-create BigQuery tables. They will be generated automatically at the first export, and since that all the incoming data will be updated. All the table names will correspond to the data sets (contact activities, contacts, order items, orders)

List of Data Export Parameters

Broadcasts

ContactActivities

*The field will be removed as overdated; use the field indicated in brackets

Contacts

Devices

Messages

OrderItems

Orders

Revenue

*The field will be removed as overdated; use the field indicated in brackets

📘

Note

Existing entries in the Revenue table (for orders placed after 03.08.2024) can be updated along with the upload of new orders. Updating may be necessary, for example, if the total cost of the order has changed.

Setting up BigQuery Connector for Data Export

1. Go to Settings → _Connectors and click _Add data source.

2. Upload the key file and check the boxes for the data sets you want to upload. Click Save.

The connection will be displayed in Connectors → Export to BigQuery, here you can edit the settings.

Configuring a Data Source

1. Go to your profile → Settings → Data sources, click New data source and select External data source.

2. Select the created connector.

3. Select dataset and table and enter a source name. Click Save.

4. Import contacts to eSputnik and fill the external source with data. Now you can build segments based on the imported contact fields.

📘

Important

Connection to the external database doesn’t presuppose contact import. Segmentation is only available for contacts that exist both in your eSputnik account and in the external database. Synchronize and update contacts before creating campaigns.

Adding data to a message is similar to adding data from PostgreSQL.