llmllmllm
Joined 3 years ago
Karma
21
Submissions
29
Member since
Jul 18
Recent submissions
Comment · 2 years ago
The UK doesn't have exit checks.
Comment · 2 years ago
I just made this after realising that chatgpt 4 now has 32k input context so it's useful to inject multiple files into my prompts easily
Comment · 3 years ago
"Show HN is for something you've made that other people can play with. HN users can try it out, give you feedback, and ask questions in the thread."
We made it, you can play with it :)
Comment · 3 years ago
This is an interface that has GPT-4 producing content while also producing images using DALL-E 3, we have integrated them.
Comment · 3 years ago
Feedback is great, thank you.
I linked to the shared report so that it's obvious what is actually being produced, rather than just a description of it.
This is just an example summary of a single web page, you could imagine it producing much more compelling content, for example combining multiple pieces of information, along with a twist, just as many humans do when publishing on the web. FlowChai could search hundreds of documents to produce a report (using RAG), so in that sense it can go beyond what a person could do in a reasonable time frame.
Comment · 3 years ago
While this makes some of what my startup https://flowch.ai does a commodity (file uploads and embeddings based queries are an example, but we'll see how well they do it - chunking and querying with RAG isn't easy to do well), the lower prices of models make my overall platform way better value, so I'd say overall it's a big positive.
Speaking more generally, there's always room for multiple players, especially in specific niches.
Comment · 3 years ago
I have found success with chunking with 100 tokens, preceeded by the last 10 tokens of the previous chunk, and the first 10 tokens of the next chunk, 120 tokens total. I generate an embedding for each, then compare that to embedding(s) derived from the input query.
How to generate embeddings from the input query well is where one's focus should be IMO. An example: "don't mention x" being turned into filtering out / de-emphasizing chunks that align with the embedding for x.
I've been using these techniques along with pgvector and OpenAI's embeddings for https://flowch.ai and it works really well. A user uploads a document or uses the Chrome Extension on a webpage and FlowChai chunks up the content, generates embeddings, builds up a RAG context and then produces a report based on the user's prompt.
I hope that helps show a real world example. You're welcome to play with FlowChai for free to see how it works in practice at the application level.
Comment · 3 years ago
Things like this needing to exist are one of the reasons we are working on https://flowch.ai/?ref=hn - the ChatGPT interface is really sub-optimal for work and keeping track of interactions over time. We have been building a much better way to organize LLM interactions, even basics like splitting things into projects and search make it a much better experience.
Comment · 3 years ago
I'll be curious to see if many people end up subscribed to both this and ChatGPT Pro, are they different enough to both be worth it?
Comment · 3 years ago
Very fair, we have demo videos, guides etc planned for the next week or so. As it's a tool that can do many things it's hard to describe. Still a lot to do :)
In terms of what makes the report different from Bing: this could be any source of data: scraped from the web, search, API upload, file upload etc, so there's a lot more power there. Also, it's not just one off reports, there's automation there which would allow for example a weekly report on the latest papers on GPT4 (or whatever you're interested in).