OpenAI has recently announced a new option for developers, offering a 50% discount for running jobs during off-peak hours. This feature, known as Batch API, allows developers to upload files or batches of queries to AI models, ideal for tasks that do not require immediate results, such as content summarization, data classification, or image labeling. According to OpenAI, developers can expect to receive results within 24 hours or even faster when resources are available.
In addition to the discount, Batch API also provides higher rate limits, such as 250M tokens for GPT-4T.
TLDR: OpenAI introduces Batch API for cost savings and increased rate limits on asynchronous tasks, providing results within 24 hours and a 50% discount on API prices during off-peak hours.
Leave a Comment