While I appreciate the efforts of authors and believe in long term mission, they seem to not mention anywhere some key shortcomings of Ray, while marketing it pretty hard (eg see the paper).
I have used ray (a year ago) in one of the advertised basic applications: parallelising the environments for RL. It was unusable back then, as it was clogging up the memory.
The plasma store which is backend for arrow was never cleaned which made the computation stop after 3 hours
I have used ray (a year ago) in one of the advertised basic applications: parallelising the environments for RL. It was unusable back then, as it was clogging up the memory.
The plasma store which is backend for arrow was never cleaned which made the computation stop after 3 hours
Here’s the issue:
https://github.com/ray-project/ray/issues/2128
Or perhaps this has been fixed already?