tompec

It doesn't embed images, no. But that's a great idea for the roadmap!

Having looked at a lot of HTMLs, I noticed that sections are not really the default. I rely on headings (h1, h2, ...) to chunk each pages. Each chunk has its heading hierarchy attached to it. There are a lot of optimizations that could be done at that level.

I chunk pages and generate embeddings for each chunk. So there's no real size limit per page.

Gotta start somewhere :)

Sorry about that, a bit too much load at the moment

Thanks! I'm still figuring things out about pricing, but there will be small plans available.

It does respect robots.txt when crawling. I'll add more details about this in the docs.

Currently just a cloud-toy.

Thanks! The chat demo is actually just a small thing I put together as a preview of what can be done, but the main product is the API. But seeing that most users seem to like that, there's probably something there... If you want to email me at support at embedding.io with some requirements, I can see how to make that work for you.

You can group as many websites as you want into a collection. Then query that collection. Not sure what you mean by exporting; you would like to export the vectors themselves? Or just the chunks of text from the websites?

Apologies, please email me at support at embedding.io. If you have something you'd like embedded, please also mention it so I can set it up for you.

It currently will try to find a sitemap on its own. But I have on the roadmap to let users add their own.

It works with pretty much any website, and works well with docs hosted on GitBook yes, I have embedded a website that's hosted there.

Tech stack is a mix of serverless Laravel, with Cloudflare and AWS functions, and some Pinecone for vector storage. Still experimenting on a few things but don't want to over-engineer unless I know where I'm going.

Unless you own those sites, I'm afraid that's not going to be possible.