Comment Comment by awaythrowact I may be wrong. It happens a lot! But I think Arrow's vision encompasses compute, not just a data format and data interface.https://www.slideshare.net/wesm/pycon-colombia-2020-python-f...Slide 43: The "Arrow C++ Platform" encompasses a "Multi-core Work Scheduler" and a "Query Engine"Slide 38: "It would be more productive (long-term) to have a reusable computational foundation for data frames"Again, I agree that, today, it's more data format, and the shared compute stuff is more a vision.EDIT: See also https://ursalabs.org/tech/ parent awaythrowact 5 years ago
https://www.slideshare.net/wesm/pycon-colombia-2020-python-f...
Slide 43: The "Arrow C++ Platform" encompasses a "Multi-core Work Scheduler" and a "Query Engine"
Slide 38: "It would be more productive (long-term) to have a reusable computational foundation for data frames"
Again, I agree that, today, it's more data format, and the shared compute stuff is more a vision.
EDIT: See also https://ursalabs.org/tech/