It's not clear how many records were generated in the sample dataset for these benchmarks. The methodology [1] and Github repo [2] show how to seed tables of 1k records, but it's not clear what size the results on the website were using.
Additionally, it seems that these benchmarks were run by executing queries serially, which isn't particularly interesting to me -- I'm more interested in what latency and resource consumption look like for each query under any type of load. The issues that we were seeing with Prisma [3] were latency in acquiring a connection and executing a query when many queries were running simultaneously (with idle connections available in the pool and a high connection limit on Postgres). I'd also be curious about the difference in performance for something like a nested `updateMany` where depending on how the query is generated, could deadlock or place a lock on more rows than necessary -- and where the generated queries actually matter.
Running queries serially against what is presumably 1k records per table doesn't seem particularly valuable.
Additionally, it seems that these benchmarks were run by executing queries serially, which isn't particularly interesting to me -- I'm more interested in what latency and resource consumption look like for each query under any type of load. The issues that we were seeing with Prisma [3] were latency in acquiring a connection and executing a query when many queries were running simultaneously (with idle connections available in the pool and a high connection limit on Postgres). I'd also be curious about the difference in performance for something like a nested `updateMany` where depending on how the query is generated, could deadlock or place a lock on more rows than necessary -- and where the generated queries actually matter.
Running queries serially against what is presumably 1k records per table doesn't seem particularly valuable.
[1] https://www.prisma.io/blog/performance-benchmarks-comparing-...
[2] https://github.com/prisma/orm-benchmarks/
[3] https://docs.hatchet.run/blog/migrating-off-prisma