mousematrix

As opposed to Substrait? I think there is certainly a path to converting to Substrait as one of the outputs for on-the-wire format to send query plans to various engines. YAML as such gives a human-diffable representation that can be checked-in to git. Let me know your thoughts...we are super early so happy to take in feedback...

I think so too...seriously considering changing the name

this is really useful. In our case, we are inspired by a terminal game called Zork, which is an Activision trademark. So, we tried to be creative and replacing Z with X made sense at the time. Of course, we did not want to be like any "dork", hence the Q.

Now I read this tought process above, I think this leaves much to be desired.

great point...honestly this will be our 3rd rebrand, but worth considering. I am just hoping that we are in a different enough space that it could slide....

While we considered Narwhals (It's pretty new) over Ibis, but ultimately we decided to go with Ibis since it supports the SQL backends that we needed.

We have ambitions of supporting alternative APIs like Narwhals in future though, that can map polars API to Ibis's internal representation.

We found Ibis to be super extensible. In xorq, we also support pandas UDFs, so if you know pandas you should be pretty well covered. UDFs are pretty nice way to extend the API.

What sort of operations did you find Ibis was missing when you tried? What about it isn't extensible?

Looks v. cool, how does gizmo handle concurrency for multiple writes? are there any limits that you have observed?