1ba9115454
Joined 9 years ago
Joined 9 years ago
I get ~45 tokens/s generation and ~680 tokens/s prompt processing.
The problem is ollama is not caching the prompt, I get -> forcing full prompt re-processing due to lack of cache data
So this wouldn't work in its current state in an agentic loop.
I would love to see Deepseek running on premise with a decent TPS.
Cornucopia generates rust code.
Very pleased with the result. It's great having the compiler help out with UI work.
Bionic-GPT
https://github.com/bionic-gpt/bionic-gpt
Rust, LLM's, RAG, Kubernetes. Generative AI.
Ideally for the over 50's but younger people also considered.
Here's a checklist for a web pentest. https://pentestbook.six2dez.com/others/web-checklist
My understanding is that you're expected to do 3 months in San Francisco and that would stop most people with a family. Which is like most people over 30.
I've been using dbmate which uses SQL and works really well.