kyeb
Joined 8 years ago
Joined 8 years ago
you would think so! but that's only optimal if the model already has all the information in recent context to make an optimally-informed decision.
in practice, this is a neat context engineering trick, where the different LLM calls in the "courtroom" have different context and can contribute independent bits of reasoning to the overall "case"
Falconer is building AI-powered knowledge tools for engineers. Knowledge management is a $30b industry, and we intend to build the tools that leverage AI to power the next generation of engineering knowledge. Our vision is to empower every engineer to write as well as the best technical writers, and enable every organization to have internal docs as great as the best external docs are.
We're currently a team of 8 from Stripe and Meta, currently turning our prototype into a generally available product.
Looking for an engineer experienced in evals, inference latency optimization, prompt caching, and LLM agent reliability. Or someone who just loves tinkering with the latest models and newly-published techniques, and wants to work somewhere you try them out in a real product that people use!
Apply at https://falconer.com/jobs, or drop your resume and a sentence or two about what AI knowledge workflows you would be excited to work on to [email protected]
- Spend time practicing away from important coding tasks (e.g. gaming, writing, a side project, a one-off script, etc.). Being able to learn in a forgiving environment, outside of deadlines, gives you the space to allow mistakes and time to correct them
The author's whole point here is that QMK (or ZMK, which I use) lets you customize it to exactly your own needs!
Falconer is building AI-powered knowledge tools for engineers. Knowledge management is a $30b industry, and we intend to build the tools that leverage AI to power the next generation of engineering knowledge. Our vision is to empower every engineer to write as well as the best technical writers, and enable every organization to have internal docs as great as the best external docs are.
We're currently a team of 5 from Stripe and Meta, prototyping the product with design partners, and hiring a few more engineers to round out the founding team. We've raised a $5m seed round and have several customers lined up, we just need to build it!
Apply at https://falconer.ai/careers, or drop your resume and a sentence or two about what AI knowledge workflows you would be excited to work on to [email protected]!
Falconer is building AI-powered knowledge tools for engineers. Knowledge management is a $30b industry, and we intend to build the tools that leverage AI to power the next generation of engineering knowledge. Our vision is to empower every engineer to write as well as the best technical writers, and enable every organization to have internal docs as great as the best external docs are.
We're currently a team of 4 from Stripe and Meta, prototyping the product with design partners, and hiring a few more engineers to round out the founding team. We've raised a $5m seed round and have several customers lined up, we just need to build it!
Apply at https://falconer.ai/careers, or drop your resume and a sentence or two about what AI knowledge workflows you would be excited to build to [email protected]!
Falconer is building AI-powered knowledge tools for engineers. Knowledge management is a $30b industry, and we intend to build the tools that leverage AI to power the next generation of engineering knowledge. Our vision is to empower every engineer to write as well as the best technical writers, and enable every organization to have internal docs as great as the best external docs are.
We're currently a team of 3 from Stripe and Meta, prototyping the product with design partners, and hiring a few more engineers to round out the founding team. We've raised a $5m seed round and have several customers lined up, we just need to build it!
Apply at https://falconer.ai/careers, or drop your resume and a sentence or two about what AI knowledge workflows you would be excited to build to [email protected]!
Falconer is building AI-powered knowledge tools for engineers. Knowledge management is a $30b industry, and we intend to build the tools that leverage AI to power the next generation of engineering knowledge. Our vision is to empower every engineer to write as well as the best technical writers, and enable every organization to have internal docs as great as the best external docs are.
We're currently a team of 3 from Stripe and Meta, prototyping the product with design partners, and hiring a few more engineers to round out the founding team. We've raised a $5m seed round and have several customers lined up, we just need to build it!
Apply at https://falconer.ai/careers, or drop your resume and a sentence or two about what AI knowledge workflows you would be excited to build to [email protected]!
- Load balancing across regions [0] without significant latency overhead
- Service-to-service mesh/discovery that scales with less than O(# of servers)
- Reliable processing (retries without causing retry storms, optimistic hedging)
- Coordinating error handling and observability
All without the engineers actually writing the functions needing to know anything about the system (which requires airtight reliability, abstractions, observability).
I don't mean to comment on whether this is impressive or not, just pointing out that per-server throughput would never be the difficult part of reaching this scale.
[0] And apparently for this system, load balancing across time, which is at least a mildly interesting way of thinking about it
prev @ stripe prev @ MIT
[ my public key: https://keybase.io/kyeb; my proof: https://keybase.io/kyeb/sigs/kQgCa7Rj7IwZS0NcgYCyKyyL5MtQ8fii5qfRTnaa_Ns ]