Comment Comment by sgdread That's what Spark is for. You can do petabyte-scale jobs... with DataFrames. parent sgdread 6 years ago