laminarflow027
Joined 6 years ago
Joined 6 years ago
Great work though, and here's to more experiments of this nature with nested data extraction. Kudos to the BAML team for coming up with such an awesome format, and kudos to the DSPy maintainers for designing such a hackable, usable framework!
Perhaps a lot of similar data engineering/analysis tasks (e.g., ETL, quantifying results, visualization) in the future can be much more easily delegated to LLMs with simple prompts via MCP servers of database systems (possibly multiple of them at the same time). It would be fascinating to see the programming patterns that emerge in this space as MCP clients/servers evolve alongside! We'd love to get feedback and hear more about how otler folks are getting LLMs to do cool stuff using database MCP servers!
Although I cannot comment too much SurrealDB's exact capabilities and performance at this point, I can definitely highlight that at the data modeling and query language-level: Kuzu's data model is a property graph model (so an actual "graph" model rather than a multi-model database) and Kuzu implements Cypher as its query language, which is already widely adopted in the industry and is very intuitive to write (for both humans and LLMs).
Although Surreal DB does indeed offer an embedded mode, Kuzu is by design 100% embedded, is super-lightweight and can run natively in many environments, such as browsers, Android applications, AWS Lambda (serverless) and we're especially designed to be a VERY Python-friendly graph database that integrates with pretty much all well-known Python libraries. Because of its columnar storage layer, Kuzu can seamlessly read and write different data formats, such as Panda/Polars DataFrame, Arrow tables, Iceberg or Delta Lake tables and seamlessly move data between advanced graph analytics libraries like NetworkX. For anything related to graph computation, Kuzu is likely to have all the right tools and utilities to help you solve the problem at hand.
In my opinion, it's a myth that databases are heavy, monolithic pieces of software, and hopefully, using Kuzu will demonstrate that it's totally possible to have data in your primary store but seamlessly move it to a performant graph storage layer when required, and move the results back with minimum friction and cost. Hope that helps!
The graph that you build is more for your own exploration and not for sharing with the outside world.
https://graindb.github.io/ https://github.com/graphflow/graphflow-columnar-techniques
Either way, thanks for sharing!