mihaich
Joined 9 years ago
Joined 9 years ago
This means it gives you the ability to set rules by which the last tokens are considered incorrect and need to be regenerated.
I have included 2 demo algorithms.
It offers support for both GGUF models (llama.cpp) and models in Huggingface format (Transformers library).
Enjoy!
Regarding your last point: yes, 20MB is a lot, but the whole point of it is to have it all on client side, within a single component you install. You can already achieve the functionality you mention with the standard MUI's autocomplete. That being said, I'll look into ways to use smaller models.
Another demo idea I had is to have an input field where the user can enter a GitHub username, retrieve all the starred repositories, and enable semantic search on the titles and descriptions of those repositories.
The main idea is that users will typically enter their own usernames, and therefore, they are familiar with the repositories they have starred, which provides a better search experience when testing the component.
Let me know if something else would work better for you.
This is a React component for searching/sorting by meaning (not by "characters included in a string", like standard search).
It uses a small ML model that runs on client side (inside the component!). When I say small, I mean ~20MB. The model will be downloaded only once (first time) and afterwards imported from browser's cache.
You can use this component to search and filter by meaning a dropdown list or an external list (like paragraphs of a webpage). You can search with sentences on sentences, not just with small words/substrings.
Here is a demo: https://mihaiii.github.io/semantic-autocomplete/
I believe this is super useful in the real world! :)
Let me know if you have any questions or feedback!
Thank you!
Remote: Yes (Worldwide)
Willing to relocate: No
Technologies: C# and .NET, SQL server, Javascript, Python, LLM & GenAI
Résumé/CV: https://drive.google.com/file/d/1Vjd6qrLAVpRuxtlzqhai-ke1DHI...
Email: please see the resume
Linkedin: https://www.linkedin.com/in/mihai-chirculescu-a65223b7
Github: https://github.com/Mihaiii