I was at the presentation last Thursday, they (OnGres) have fully open sourced both their methodology and their results and had a pretty strict divide between teams designing the benchmarks and teams running the benchmarks.
MongoDB could create a Pull Request/Merge Request against that repository so we can all judge those results ourselves, their current response is only words and a single table showing unlikely results.
However I do think the criticism of not tuning MongoDB is valid, however their response is dishonest:
> with their own heavily tuned PostgreSQL.
This was explicitly not the case according to OnGres other than the established norms of taking 25% memory for `shared_buffers` etc. No other tuning that is normally done for big clusters was done.
MongoDB could create a Pull Request/Merge Request against that repository so we can all judge those results ourselves, their current response is only words and a single table showing unlikely results.
However I do think the criticism of not tuning MongoDB is valid, however their response is dishonest:
> with their own heavily tuned PostgreSQL.
This was explicitly not the case according to OnGres other than the established norms of taking 25% memory for `shared_buffers` etc. No other tuning that is normally done for big clusters was done.
https://gitlab.com/ongresinc/benchplatform/ https://gitlab.com/ongresinc/txbenchmark