brettdav
Joined 6 years ago
Karma
2
Submissions
14
Member since
Mar 18
Recent submissions
Comment · 1 month ago
Interesting, thank you. I'll check whether a setting on CF might be interfering. The site checks headers for routing and response types, but it shouldn't affect access.
Comment · 1 month ago
Integrating live bots to demonstrate live visitor experiences is a nice touch. I got an unexpected blocker (`Default Python urllib User-Agent gets 403'd by anc.dev`) I am not able to reproduce yet. Can you expose the scripts that the agents generate?
I took a different route with https://anc.dev (scored 100 on ax-check) and rely on a wider variety of compliance tests. Beyond websites, it also audits binaries (think CLI tooling) to help inclined developers ensure their tools are discoverable by and useful to agentic systems.
Comment · 1 month ago
The mcp audit at https://anc.dev/ covers all flavors of mcp, including the recently launched webmcp. Remediation prompts, accessible equally by agents and humans, can help close any gaps. Usually one-shot, unless your site is crazy complicated.
Comment · 1 month ago
What about Cloudflare’s public DNS? https://developers.cloudflare.com/1.1.1.1/setup/#1111-for-fa...
1.1.1.2
1.0.0.2
2606:4700:4700::1112
2606:4700:4700::1002Comment · 1 month ago
Yes, that makes sense. Some of my models currently run in ollama while others require their own inference servers. I’m curious about custom inference servers in bifrost and the ability to orchestrate keeping some models warm in memory while evicting and cycling other models. All of which span different providers in bifrost (I think). Obviously I can get the mechanics from an agent, more wondering about any experience with something similar.
Comment · 1 month ago
I’ve deployed mcp to prod on numerous internal apps where ai-integration has been first party requirement. Obviously, agents can use an existing api, however maximum capability requires it to be well designed and documented. As many of you may have experienced, that is not something that can be assumed and improvements may be “impossible” or at least out of current scope.
That’s where mcp (and recently webmcp) have their benefits. By design, the protocols provide predictable structure that allows agents to discover and use the tools you provide.
I’ve had success using mcp variously as an agent friendly wrapper to an existing api and as a greenfield product designed for agentic workflows. Agentic workflows can string together multiple api endpoints together into a single tool call and or use their own dedicated backends.
To share my learnings, I’ve released a free tool at https://anc.dev . While It’s still very much a work in progress, I’d love dialog and constructive feedback.
Comment · 2 months ago
Can you share a bit more about your bifrost and llama swap setup? I’m facing memory constraints and am looking for a managed model solution that will help with hot swapping loaded models and stay-warm concurrency. Ideally with prioritization.