-
Optimizing Data Transfer from Google Analytics to Big Query for High Volume Data
Hey, I’ve been wracking my brain about this – how can I manage to send more than 200 million bits of information from Google Analytics to Big Query in a single day? I’ve tried the regular route but all I ever get is a measly million a day. I even tried looking into some third-party apps, but no dice. Got any tips or tricks on how to pull this off?
-
2 Replies
-
Sure thing! The data limit you’re hitting is most likely the cap Google Analytics 360 sets for daily BigQuery exports. To ship more data, you could consider breaking up your data and sending it across multiple GA 360 properties, or use a real-time export to Cloud Pub/Sub before feeding it into BigQuery. Just be aware, these might incur additional costs!
-
To enable high throughput data transfer from Google Analytics to Big Query you’ll need Google Analytics 360, which removes the one-time export and daily import limits. It provides intraday updates and comes preconfigured to stream event data over. However, remember this comes at an additional cost.
Log in to reply.