GOV.UK Universal Analytics (BigQuery export)
We export our GOV.UK Universal Analytics data and store it in Google BigQuery. This enables more detailed analysis and the use of GOV.UK UA data by other tools.
Universal Analytics (UA) sends GOV.UK visitor journey data to the govuk-bigquery-analytics.87773428.ga_sessions_intraday_YYYYMMDD table 3 times a day, where:
govuk-bigquery-analyticsis the project ID87773428is the dataset namega_sessions_intraday_YYYYMMDDis the table nameYYYYMMDDis the current date in year-month-day format
At the end of the day, UA automatically:
- moves the data in this intraday table to a
ga_sessions_YYYYMMDDtable - deletes this intraday table
- creates a new intraday table for the next day
Access
Everyone with a @digital.cabinet-office.gov.uk account (all GDS staff) has access to the data.
Location
This data is stored in BigQuery in the govuk-bigquery-analytics.87773428 dataset.
Like all of our data, this is located in the europe-west2 GCP region.
For more information on our Google Cloud Platform projects, see our GCP project documentation.
Schema
The UA BigQuery Export schema defines the schema of these tables. However, not all columns are filled in our tables.
| field name | type | mode |
|---|---|---|
| visitorId | INTEGER | NULLABLE |
| visitNumber | INTEGER | NULLABLE |
| visitId | INTEGER | NULLABLE |
| visitStartTime | INTEGER | NULLABLE |
| date | STRING | NULLABLE |
| totals | RECORD | NULLABLE |
| trafficSource | RECORD | NULLABLE |
| device | RECORD | NULLABLE |
| geoNetwork | RECORD | NULLABLE |
| customDimensions | RECORD | REPEATED |
| hits | RECORD | REPEATED |
| fullVisitorId | STRING | NULLABLE |
| userId | STRING | NULLABLE |
| clientId | STRING | NULLABLE |
| channelGrouping | STRING | NULLABLE |
| socialEngagementType | STRING | NULLABLE |
| privacyInfo | RECORD | NULLABLE |