localbuilder
Joined 1 year ago
Joined 1 year ago
Does SwiftUI have properties that uniquely make this type of interpreted system possible, or could it also use UIKit under the hood? On the surface, it seems like UIKit might be more difficult since you’d probably need to parse all of the obj-c header files in addition to the .swiftinterface.
Very cool stuff, excited to follow along how you all develop the product!
This is the biggest problem I've encountered with evals for agents so far. Especially with agents that might do multiple turns of user input > perform task > more user input > perform another task > etc.
Creating evals for these flows has been difficult because I've found mocking the conversation to a certain point runs into the drift problem you highlighted as the system changes. I've also explored using an LLM to create dynamic responses to points that require additional user input in E2E flows, which adds its own levels of complexity and indeterministic behavior. Both approaches are time consuming and difficult to setup in their own ways.
I like that practice. That way you’re always conscious of everything in flight and stuff isn’t slipping through the cracks. Will be looking into that system more
Calendly is more external facing, it’s a great tool for scheduling meetings with people that aren’t in my organization such as inbound sales prospects
Our goal here is to offer a turn-key solution that drops into your existing tools and just works out of the box, so you don’t need to build any of those integrations yourself