Discussion Ask HN: Batch Processing with OpenAI So I have 10,000 paragraphs I want to individually process with a prompt.Any packages that would handle running things async, doing retries, handling the occasional hung connection, and logging performance?Tried helicone, but I don't think it handles the hung connections.Just doing it manually for now, but there must be an existing solution? 9 points nantersand 3 years ago 11 comments
Any packages that would handle running things async, doing retries, handling the occasional hung connection, and logging performance?
Tried helicone, but I don't think it handles the hung connections.
Just doing it manually for now, but there must be an existing solution?