Recent submissions

Comment · 17 days ago
Thanks. I'll seek an alternative
Comment · 17 days ago
I'm running a Ryzen 7 8745HS with Radeon 780M (27GB RAM), using Ollama's Vulkan backend.

I get ~45 tokens/s generation and ~680 tokens/s prompt processing.

The problem is ollama is not caching the prompt, I get -> forcing full prompt re-processing due to lack of cache data

So this wouldn't work in its current state in an agentic loop.

Comment · 21 days ago
Nitter is/was a free, open-source alternative front-end for X (formerly Twitter) that lets users view public posts without an account, ads, or tracking scripts.
Comment · 1 year ago
I can't imagine this setup will get more than 1 token per second.

I would love to see Deepseek running on premise with a decent TPS.

Comment · 2 years ago
https://github.com/cornucopia-rs/cornucopia

Cornucopia generates rust code.

Comment · 2 years ago
A tenary is all you need.
Comment · 2 years ago
We're using Dioxus on the backend with Axum for https://github.com/bionic-gpt/bionic-gpt

Very pleased with the result. It's great having the compiler help out with UI work.

Comment · 2 years ago
SEEKING VOLUNTEERS

Bionic-GPT

https://github.com/bionic-gpt/bionic-gpt

Rust, LLM's, RAG, Kubernetes. Generative AI.

Ideally for the over 50's but younger people also considered.

Comment · 2 years ago
Comment · 3 years ago
Why did you say you didn't play an instrument when you did?
Comment · 3 years ago
What would be the outcome of this? Are you trying to reduce the gap between the poor and the wealthy?
Comment · 3 years ago
I seriously doubt that YC discriminates on age deliberately.

My understanding is that you're expected to do 3 months in San Francisco and that would stop most people with a family. Which is like most people over 30.

Comment · 3 years ago
I didn't look too deep at this as soon as it said JSON. I was gone.

I've been using dbmate which uses SQL and works really well.

Comment · 3 years ago
The vendors performance metrics rate their own product the highest marks.
Comment · 3 years ago
That's really cool.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton