Smilinrobin
Joined 3 years ago
Karma
3
Submissions
16
Member since
Oct 7
Recent submissions
Comment · 1 year ago
We've added Playwright's Tracing capability for debugging end to end agentic test execution by our open source testing agent: https://github.com/test-zeus-ai/testzeus-hercules/. Coupled with the capability to log thoughts and inner monologue of the agent, now our users can review the direction taken by the agent; and steer it in the right direction.
Or catch hidden bugs in the application under test.
Comment · 1 year ago
Thanks. Also, while Hercules can do Salesforce, we've also checked it for complicated scenarios on the web (and there's an eval folder too). We'd love to know about your feedback and thoughts.
Comment · 1 year ago
In theory , yes we could, but would it yield "good enough" results for a "testing" agent- Probably not. The LLM here is actually not just responsible for tool calling, its also doing other intricate things such as planning the next steps based on the input feature file, and generating the browser/API automation code. In our experiments we found that OpenAI 4o performs best, followed by Haiku or Grok.
Comment · 1 year ago
THanks HackerNews for not letting us update the post.
But the Discord link had some bug (yes, we need more testing), so here's the link for joining our Discord server: https://discord.gg/JhSAGhfR55
Comment · 1 year ago
1 - Yes, thats the whole idea (almost)
2 - LLM based
3 - Understands and acts on multi layered DOM
4 - Its available as a docker container. Plus we offer paid solutions for real large scale deployments
5 - Yes, planning for it.
Thanks.
Comment · 1 year ago
You can already try other LLMs. Steps in docs.