jordn
Joined 14 years ago
Karma
3,328
Submissions
240
Member since
Apr 19
Recent submissions
Comment · 15 days ago
Passing that on to the right team! Thank you!
Comment · 15 days ago
Hey @rsorto – sorry about this! I work at Anthropic and can see that there's a UI/form bug which didn't account for internationalization very well. A typed "5,04" got converted to $504. We're fixing the bug now and the support team will reach out to you directly to address your case, shortly.
Comment · 1 year ago
HUMANLOOP | London and San Francisco | Full time in person (can sponsor visa) | https://humanloop.com
We're building the LLM Evals Platform for Enterprises. Duolingo, Gusto, and Vanta use Humanloop to evaluate, monitor, and improve their AI systems.
ROLES:
- Product Engineer
- Frontend Engineer
---
WHAT YOU'LL DO:
Product Engineer:
- Build features across our full stack that help teams build awesome AI systems
- Work closely with customers to understand their needs and translate them into product features
- Help shape our product roadmap and technical architecture
Frontend Engineer:
- Create intuitive interfaces for complex AI workflows - Build collaborative tools that enable both technical and non-technical users to work together
- Help craft our frontend architecture and component system
---
WHY JOIN:
- See the future first. See leading companies build the frontier of AI experiences. Define the new development workflow for doing so.
- Join at an exciting time - we've raised funding from YC Continuity, Index Ventures, and industry leaders
- Work with small hard working team that includes alumni from Google, Amazon, Cambridge, and MIT
- Competitive salary and equity
- Regular team events and offsites (recent trips to NYC and rural Bedfordshire)
---
Apply: Email [email protected] with "HN" in the subject line
Comment · 1 year ago
For those curious: Humanloop is a evals platform for building products with LLMs. We think of it as the platform for 'eval-driven development' needed for making AI products/features/experiences that work well
We learned three key things building evaluation tools for AI teams like Duolingo and Gusto:
- Most teams start by tweaking prompts without measuring impact
- Successful products establish clear quality metrics first
- Teams need both engineers and domain experts collaborating on prompts
One detail we cut from the post: the highest-performing teams treat prompts like versioned code, running automated eval suites before any production deployment. This catches most regressions before they reach users.
Comment · 2 years ago
People often think that fine-tuning is what the should be aiming for.
Funnest part from the talk was the story of fine tuning GPT-3.5 on the company slack so it "learned their tone of voice".
The result:
> Human: Write a 500 word blog post on prompt engineering > AI: Sure I shall work on that in the morning" > Human: "Do it now > AI: "ok"
Comment · 3 years ago
Principles for coworker:
Context Aware - Unlike other AI chatbots, it should have knowledge of your context. The conversation your having, the background goals at your company etc.
Extensible - It should be extremely easy for a developer to add a new capability to the coworker that's relevant for their company.
Human in the loop - We want to give Coworker really powerful capabilities. To do that in a way that maintains trust, it should be transparent to a user what the AI is doing and always get approval for its actions.
Comment · 3 years ago
What have been some of your learnings for getting agents to work?
Comment · 3 years ago
Is this good/stable now? Worth switching from Pettier and eslint?
Comment · 3 years ago
Humanloop (YC S20) | London (or remote) | https://humanloop.com
Humanloop is helping the coming wave of AI startups build impactful applications on top of large language models. Our tools add capabilities, evaluate performance and align these systems with human feedback to create real world value.
Here's a recent video interview between YC and Raza explaining what we do: https://www.youtube.com/watch?v=hQC5O3WTmuo
We're looking for exceptional engineers that can work at varying levels of the stack (frontend, backend, infra), who are customer obsessed and thoughtful about product (we think you have to be -- our customers are "living in the future" and we're building what's needed).
Our stack is primarily Typescript, Python, GPT-3.
Please apply at https://www.workatastartup.com/companies/humanloop and feel free to reach me at [email protected]
Comment · 4 years ago
Humanloop (YC S20) | London or Remote | https://humanloop.com
Humanloop is to helping the coming wave of AI startups build impactful applications on top of large language models. AI is the new platform and we're building the platform to align these systems with human feedback and create real world value.
We're looking for product engineers that can work at varying levels of the stack (frontend, backend, infra), who are customer obsessed and thoughtful about product (we think you have to be -- our customers are "living in the future" and we're building what's needed).
Our stack is primarily React, Python, GPT-3.
You can see more the roles at https://www.workatastartup.com/companies/humanloop, and feel free to reach me at [email protected]
email -> jordan AT humanloop.com
http://twitter.com/jordnb YC Badge: jordn.eth