Comment by MakeUsersWant

I'd love property-based testing in big data cluster computing applications done in Databricks/Spark. However, (Py)Spark is very high-latency, even in local mode, so Hypothesis would have to generate a list (DataFrame) of thousands of test cases to be evaluated in parallel. That is where I got stuck. Has anybody ever done this successfully?