Absolutely, I can help you better understand this. In the new GA4 version 1 beta, the nextPageToken you might be used to from the older versions has been replaced by an ‘offset’ parameter in the API. How this works is, the return size from Google has a limit of 10,000 rows.

Now, let’s say you’re dealing with larger data. Here’s a nifty trick you can use, get into a habit of running a query with a predefined iterator that increases by 10,000 for each return. You can pass this number into the ‘offset’ parameter of the API. If the return is less than 10,000 rows or elements, take it as a sign that there’s no further data you can extract from that particular query.

Just keep in mind, though it’s possible to have certain caps and quotas removed with payment, the return size cap of 10,000 rows is non-negotiable.

I hope this makes your work with Azure Data Factory a little less puzzling and bit more exciting. Don’t hesitate to dive in and experiment!