This article is actually a bit of an advert for when not to do batch processing. Processing 30 X 80B events every day when the same result can be achieved by maintaining state on about 30B users (more than enough for acceptable global coverage) and stream the data through to update that state. If all you were doing is the attribution part you would be looking a near an order of magnitude saving on their current costs and deliver results in real time.
The ML side may well benefit from batch but I bet splitting out the attribution component would allow them to be more flexible and cost efficient in their approach there.
The ML side may well benefit from batch but I bet splitting out the attribution component would allow them to be more flexible and cost efficient in their approach there.