BigQuery is Google’s fully managed, petabyte scale, low cost analytics data warehouse.

Enable the Connection

  1. Enable BigQuery in your project in Google Cloud Platform.
  2. From the IAM page for your project, add as a member with the role of Project Viewer.
  3. From the BigQuery page for your project:

    • Create a dataset for your app data to be loaded into.
    • Click on Share Dataset on the dataset page.
    • Add with the “BigQuery Data Editor” role.
  4. Connect your audience from the Audiences page in the mParticle dashboard. You’ll need to enter your BigQuery Project ID and Dataset ID.

BigQuery Schema

All of your audience data is stored in a single BigQuery dataset. Multiple audiences can be sent to each dataset. The data sent to BigQuery is not the current state for the audience, but changes to the audience over time as users are added and removed.

For each audience, mParticle creates one table per week, showing all users added to, or removed from the audience each week. Table names are in the format audience_{Audience ID}_{Beginning of the week in yyyyMMdd format}. For example, if your Audience ID is 7185, data for the week beginning on April 15 2018 will be written to a table named audience_7185_20180415.

To find the ID of an audience in the mParticle Dashboard, look for your audience name in the Audiences summary page.

Table fields

Field Name Data Type Description
androidid string Android ID
audienceid int ID of the Audience
audiencename string Name of the Audience
customerid string Customer ID
email string Email
facebookid string Facebook ID
googleaid string GAID (Google Advertising ID)
googleuserid string Google User ID
idfa string IDFA (Apple Advertising ID)
idfv string IDFV (Apple Vendor ID)
isadd bool true for a user added to an audience. false for a user removed
microsoftid string Microsoft ID
mpid int mParticle ID
otheruserid string Other User ID
pushtoken string Push Token
rokuaid string Roku Advertising ID
rokupublisherid string Roku Publisher ID
timestamp string Unix timestamp for the update
twitterid string Twitter ID
yahooid string Yahoo ID

Customer ID Only Option

You can opt to only send Customer ID to BigQuery by checking Only Send Customer ID in the Configuration Settings

Upload Frequency

The BigQuery Audience Integration uses Bulk Forwarding. Bulk Forwarding means that, instead of uploading updates to an audience in real time, mParticle compiles updates into a queue until either a given amount of time has passed since the last upload, or until a certain number of updates are waiting to be sent.

By default, mParticle uploads to BigQuery whenever at least one of the following conditions is met:

  • At least 5 messages are in the queue.
  • 70 days have passed since the last update.

Upload frequency can sometimes be adjusted. Reach out to your mParticle Customer Success Manager if you need to discuss upload frequency.

Configuration Settings

Setting Name Data Type Default Value Description
BigQuery ProjectId string ProjectID for your BigQuery project.
BigQuery DatasetId string Target dataset for audience data
Only Send Customer ID bool false If enabled, only the Customer ID and no other identites will be forwarded.

Was this page helpful?