do-me
Joined 4 years ago
Karma
50
Submissions
22
Member since
Sep 29
Recent submissions
Comment · 3 years ago
Just quantized the models for onnx usage in e.g. transformers.js and got 4x reduced file size:
- 𝟐𝟖.𝟓 𝐌𝐁 jina-embeddings-v2-small-en (https://huggingface.co/do-me/jina-embeddings-v2-small-en)
- 𝟏𝟎𝟗 𝐌𝐁 jina-embeddings-v2-base-en (https://huggingface.co/do-me/jina-embeddings-v2-base-en)
However, I noted, that the base model is performing quite poorly on small text chunks (a few words) while the small version seems to be unaffected. Might this be some kind of side effect due to the way they deal with large contexts?
If you want to test, you can head over to SemanticFinder (https://do-me.github.io/SemanticFinder/), go to advanced settings, choose the Jina AI base model (at the very bottom) and run with "Find". You'll see that all other models perform just fine and find "food"-related chunks but the base version doesn't.
Comment · 3 years ago
That's awesome and so much more practical than scrolling through HN.
It would also be possible to integrate semantic search so people don't necessarily need to know the keywords. If you're interested, feel free to ping me or take a look at https://github.com/do-me/SemanticFinder. In case I could just create a pre-indexed version based on your data dump which would be quite convenient to use.
Comment · 3 years ago
https://geo.rocks
My open source blog mainly with (geospatial) niche tutorials.
It's a pretty personal thing as I mostly (but not only) derive the blog posts from challenges I encounter during work or my PhD research. In this way it documents my learnings and serves as a quite verbose personal wiki.
Comment · 3 years ago
Awesome project! From the website I wasn't quite able to tell where exactly and how AI comes into play.
I think apart from fuzzy searching headings a semantic search functionality for the whole text would be a really nice default feature. I implemented frontend-only semantic search with transformers.js here: geo.rocks/semanticfinder. The implementation is very straightforward and it would be easy to integrate in the browser, maybe as a plugin or similar.
https://geo.rocks/about https://www.linkedin.com/in/dominik-weckmüller/ https://bsky.app/profile/domegis.bsky.social https://fosstodon.org/@DomeGIS