Ask HN: Batch Processing with OpenAI

The author is seeking a software package that can efficiently process 10,000 paragraphs individually with a prompt. They require a solution that can run tasks asynchronously, manage retries, handle occasional connection issues, and log performance. They have tried using the helicone package, but it does not meet all their needs, particularly in dealing with hung connections. Currently, they are processing the data manually and are in search of an existing, more efficient solution.

Key takeaways

The user is looking for a package to process 10,000 paragraphs individually with a prompt.
The package should be able to run things asynchronously, retry tasks, handle occasional hung connections, and log performance.
The user has tried helicone but it doesn't handle hung connections.
The user is currently handling the task manually and is seeking an existing solution.

Ask HN: Batch Processing with OpenAI

Key takeaways

Discussion (0)