Comment by rgraham

I don't have as much experience with pandas, but I've used window functions and psql queries in place of that sort of data munging for production web applications. We have tens of millions of rows and near real time reporting requirements.

Reach out if you want to compare notes.