MK2k
Joined 6 years ago
Joined 6 years ago
Ollama's OpenAI-compatible endpoint (/v1/chat/completions) has serious runtime configuration limitations.
Without custom model files, parameters such as context size cannot be centrally controlled. Requests through the OpenAI compatibility layer may run with Ollama defaults instead of the desired runtime settings.
This proxy uses Ollama's native /api/chat endpoint directly, where runtime parameters are explicitly supported.
One .env file configures all models centrally.
> STOP asking Claude Code to design your apps. It’s great for logic, not design. Google Stitch 2.0 + Claude Code via MCP is the workflow that finally fixes the AI slop problem.
Same with more complex systems: entire shop systems with payment integration, ERP and all – heavily supported by LLM code tools with a 3-10x productivity boost, just done by the CTO and no additional developers needed. They exist, the shop greets it’s customers and all you see is Vue and Tailwind as the tech stack where Shopify could’ve been. It’s now completely owned by the company selling things (they just don't sell the software).
Socials: - github.com/theMK2k - mastodon:mastodon.social/@MK2k
Interests: Gaming, Media, Music, Programming
---