tuanacelik
Joined 6 years ago
Karma
8
Submissions
28
Member since
Oct 16
Recent submissions
Comment · 1 year ago
So just to let me get this straight: Does this new setup aim to make it easier to contribute to llamaindex submodules specifically?
Comment · 2 years ago
Haystack used to be distributed with the package farm-haystack (which continues to distribute 1.0), but yesterday we release Haystack 2.0 with a new package: haystack-ai
Haystack used to be a framework that centered around semantic search and retrieval, first released in 2020. And while the design allowed us to extend to new LLM technologies, it wasn’t an intuitive developer experience for our users. So we made the decision to completely rewrite the fundamentals of the framework. The new design provides a uniform way for _extending_ the framework. And makes it very transparent how AI components interact with eachother.
The announcement article explains our reasons for this major rewrite.
Comment · 3 years ago
I'm the culprit for Discord. But come join us! We host office hours and have NLP chats pretty often :)
Comment · 3 years ago
Documentation: https://docs.haystack.deepset.ai/docs
Tutorials: https://haystack.deepset.ai/tutorials
Blog: https://haystack.deepset.ai/blog
Comment · 3 years ago
Indeed this tutorial on Haystack is a good one as an example: https://haystack.deepset.ai/tutorials/22_pipeline_with_promp...
It combines a retrieval step followed by a prompt layer which inserts the relevant context into the prompt. You can however change the 'retrieval step' with something that uses a proper embedding model and OpenAI also provides those if you want to. I tend to use lighter (cheaper) OSS models for this step though. PS: There's some functionality in the PromptNode to make sure you don't exceed prompt limit.
Comment · 3 years ago
Hey, thanks for posting our article. I see a few comments here about memory: This is indeed a challenge which we're working on. And some other topics at hand are making oss models available for our implementation of the agent as well