giarec

Thank you. Yes, especially if you have something to calibrate against. For direction you can calibrated agains the log returns of the price to achieve the best correlation, this is what we do in our news indexes. The importance and coin affected cases are likely similar to how we calibrated the moderation kit, you will just need some labeled data (100/200 sample are often enough). In github.com/spinfinc/spinf-client you can find an example of how to fit thresholds (moderation.fit_thresholds) and if something is unclear feel free to open an issue and I'll be happy to help.

Yes, determinism is actually something we spent a lot of time to achieve. The general answer is yes, especially on certain architectures, with some caveats and some methods to increase it. You can find more info in docs/BATCH_INVARIANCE.md

We built spinf-serve for our own needs: analyzing millions of news articles a day from many perspectives (we run trading analysis on them), and decided to open-source it since there seems to be interest in this kind of tool.

It serves a niche: scoring or classifying text, images and video under many questions at once. The content is read once and every question is answered as a branch of that read, so each extra question costs only its own tokens. Trading analysis is our use; content moderation and inbound triage are the other obvious fits. Compared with the alternatives we measured (vLLM with prefix caching, and dedicated decision models) it is very token-efficient and 2 to 3 times faster on the same card; the job set and the script are in the repo.

It runs supported open-weights models; we started with Gemma 4 and Qwen3.8. We also tested Perplexity's pplx-decider: for hard-cut decisions (yes/no, A/B/C) a decision model tends to be more focused, but for scoring we found that out-of-the-box models give more sensitivity and a wider range of scores.

For our typical scoring needs we introduced prompt packs, a formalized way to ship a set of questions for parallel scoring, with calibration and a decision rule in one file.

The server is free and open source (Apache 2.0), and it is what we run in production for our own use cases. Let us know what you think.

There is also a hosted version with free credit if you have no GPU.