Cloudflare, a leading internet security company, recently celebrated its anniversary by introducing a new AI service. The current scenario involves AI models running in two different cases. The first case is running on user devices (on-device) and is suitable for smaller models, such as image search. The second case is running on Cloudflare’s expansive cloud infrastructure, specifically on the ChatGPT platform, which is designed for larger models.
However, running AI on the cloud poses challenges due to the limitations of large GPU resources mainly located in the United States, causing latency issues for some users. While running AI on devices is not sufficient, Cloudflare identifies this gap and aims to provide AI processing resources through its network connectivity that is both scalable and globally accessible. By the end of this year, Cloudflare plans to offer this service in 100 cities across more than 40 countries, eventually expanding to cover its entire global network by 2024.
Cloudflare’s AI services include several offerings:
1. Workers AI: This service allows AI models to run through the nearest GPU servers and users only pay for the usage. It supports popular models like Meta’s llama and OpenAI’s whisper.
2. Vectorize: This service provides vector-based database capabilities to work seamlessly with Workers AI.
3. AI Gateway: This portal displays graphical insights and workload-related data of all AI operations, enabling easy configuration and issue prevention.
In summary, Cloudflare celebrates its milestone by introducing a new AI service. It overcomes the challenges of running AI on the cloud by offering scalable and globally accessible AI processing resources through its network connectivity. With offerings like Workers AI, Vectorize, and AI Gateway, Cloudflare aims to revolutionize the AI landscape.
TLDR: Cloudflare, a leading internet security company, introduces a new AI service to overcome the challenges of running AI on the cloud. It plans to provide globally accessible AI processing resources through its network connectivity, covering 100 cities across more than 40 countries by the end of this year. Cloudflare’s AI services include Workers AI, Vectorize, and AI Gateway, which aim to revolutionize the AI landscape.
Leave a Comment