OpenAI has introduced additional features catered towards enterprise customers, offering API features focusing on security, assistant systems, and cost management tools.
For security standardization, organizational tools such as Private Link for connecting Azure with OpenAI, multi-step MFA authentication, and newly added certifications like SOC 2 Type II, SSO, AES-256 encryption, data transmission via TLS 1.2, role-based access control, and HIPAA compliance for healthcare client data storage requirements.
Project management tools within “Projects” have also been enhanced to oversee all projects on OpenAI, allowing for API key issuance per project, limiting or granting usage for each model, and setting project-level usage limits that are not tied to individual accounts.
The Assistants API introduces enhancements like file_search for up to 10,000 files, support for streaming conversations, vector_store data storage, and limiting the maximum tokens per run.
Lastly, cost-reducing tools such as requesting up to a 50% token reduction when utilizing a fixed rate per minute (TPM) and the newly launched Batch API for tasks that do not require immediate results.
Source: OpenAI
TLDR:
OpenAI unveils enterprise-grade features including enhanced security measures, project management tools, Assistant API upgrades, and cost-saving initiatives like token reduction and Batch API for non-time-sensitive tasks.
Leave a Comment