strzibny
Joined 9 years ago
Joined 9 years ago
I am using RubyLLM for quite some time and I am in love with the API design. If someone wants to see how this looks in a real project including custom tools, you can have a look at the SerpTrail project on GitHub.
The Chat model still is just:
class Chat < ApplicationRecord
acts_as_chat model: :llm_model
end
More: https://github.com/serpapi/serptrailI am quite excited for RubyLLM 2.0 and beyond.
we used FOSS before Google, but had to switch (there was some pushback internally)
not sure what happened after IMB took over.
I am also writing an "indie book" on getting to $100k revenue (and I write it inside LakyAI, no less!).
If you want something even simpler, something that doesn't run on your servers at all, you can look at Kamal: https://kamal-deploy.org
What I like about Kamal is that it's backed by a company that actually fully moved out of K8s and cloud, so every release is battle-tested first.