Recent submissions

Comment · 1 year ago
Comment · 2 years ago
I made a simple framework for LLM sampling algorithms that can discard generated tokens.

This means it gives you the ability to set rules by which the last tokens are considered incorrect and need to be regenerated.

I have included 2 demo algorithms.

It offers support for both GGUF models (llama.cpp) and models in Huggingface format (Transformers library).

Enjoy!

Comment · 2 years ago
Thanks for the feedback! I'll find time to make it better and retry the submission. Now I know it's actually possible to get on the first page :)

Regarding your last point: yes, 20MB is a lot, but the whole point of it is to have it all on client side, within a single component you install. You can already achieve the functionality you mention with the standard MUI's autocomplete. That being said, I'll look into ways to use smaller models.

Comment · 2 years ago
This makes sense, thank you very much for the feedback!

Another demo idea I had is to have an input field where the user can enter a GitHub username, retrieve all the starred repositories, and enable semantic search on the titles and descriptions of those repositories.

The main idea is that users will typically enter their own usernames, and therefore, they are familiar with the repositories they have starred, which provides a better search experience when testing the component.

Let me know if something else would work better for you.

Comment · 2 years ago
Comment · 2 years ago
Very cool idea! Congrats!

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton