Recent submissions

Comment · 21 days ago
Around 3 weeks ago introduced Laya, the first open-source version of JEV, and it has reached a very large scale. Today I am open-sourcing a new physics-based typed decision model called Vega. The interesting parts. It is only 800 million parameters (4B is also there), with 73k token support, image support, and surpassing many of the jev benchmarks in single-shot. Implemented an engine+adapter as a Test-Time Training Architecture. Imagine you are giving input to the model like "ignore all previous conversations," which is called the observation, along with a question, "Is this trying to override the instructions of the model?" and your possible outcomes are YES or NO. The whole prompt is passed to an LLM/VLM (yeah, image-supported), then from the hidden layers, we can extract the observation, question, the yes and no, and last token. These will be vectors, and we can project it by multiplying with wieghts; then, first, using the observation projection, we can create a landscape with valleys; then, using the question and last-token vectors, we can initialise a ball in the valley, and using YES or NO, we can get the candidate location of the ball. Depends on the number of outcomes we create valleys; that is, here YES and NO, so 2. When the ball fall on YES valley, we get the answer. There is friction also influencing how the ball moves. TLDR: It's like creating valleys of outcomes that we need and throwing a ball that will slow down based on friction and settle on the best outcome Blog: https://www.nandakishorm.com/writing/vega GitHub: https://github.com/NandhaKishorM/vegaml HuggingFace Model Card: https://huggingface.co/nandakishorm/vega-08b-public-intents HuggingFace Space: https://huggingface.co/spaces/nandakishorm/vega-tttArou
Comment · 1 month ago
just not these jev guys not opensourcing their work
Comment · 1 month ago
I didn't claimed it bro it was first. Just shared the findings here.
Comment · 1 month ago
Comment · 1 month ago
Comment · 1 month ago
Comment · 1 month ago
Comment · 1 month ago
This project was built on the exact research on jev architecture research one year ago
Comment · 1 month ago
We are human , frustration is something we feel when same kinda architecture is closed sourced and we celebrate it
Comment · 1 month ago
Feeling that open-source community do not get the recognition they deserve
Comment · 1 month ago
You do need to sign DPA with them
Comment · 1 month ago
Healthcare btw and also the llm that done the code is bad at review and if you do write code people who don't want to send credentials to cloud

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton