Microsoft has introduced a new Computer Use feature in Copilot Studio for UI Automation, where AI Agents can click, type, and interact with top apps and websites without using APIs.
The Microsoft Copilot Studio platform allows everyone to create their own Bots and AI Agents. The Computer Use feature operates on a framework hosted by Microsoft and utilizes the Computer-Using Agent (CUA) model from OpenAI to enable AI Agents to respond to data and events independently based on predefined conditions and tasks. For example, extracting data from invoices and automatically inputting it into the accounting system.
Organizations interested can find more details on the Microsoft Copilot Studio Blog website and can fill out a form to try out the Computer Use feature.
TLDR: Microsoft introduces Computer Use feature in Copilot Studio for UI Automation, enabling AI Agents to interact with apps and websites without APIs.
Leave a Comment