Comment by tab_jockey

We built an AWS serverless app that handles:

- Configurable context and cases mapped to a RESTful API

- Multi-account and high throughput error handling

- DDB backed records of all requests and responses for evaluation, debugging & training

- One-click devops deploy

Has helped us deploy and maintain LLM apps into production quite easily. Let me know if you would like access to the repo.