Microsoft Copilot Studio Introduces UI Automation with Computer Use Feature
Microsoft Copilot Studio now includes a computer use feature enabling agents to interact with websites and desktop applications. Join the limited preview to explore this new capability.
Microsoft has announced a groundbreaking addition to Copilot Studio: the computer use feature, enabling AI agents to interact directly with websites and desktop applications. This innovation marks a significant leap in automation, allowing agents to perform tasks like clicking buttons, selecting menus, and typing into fields—just as a human would.
Key Features of Computer Use
- UI Interaction: Agents can now navigate and manipulate graphical interfaces, even without APIs.
- Adaptive Reasoning: The tool adjusts to changes in real time, ensuring uninterrupted workflows.
- Enterprise-Grade Security: Built on Microsoft’s compliance frameworks, it keeps data within Microsoft Cloud boundaries.
- Cross-Browser Support: Works with Edge, Chrome, and Firefox.
High-Value Use Cases
- Automated Data Entry: Streamlines large-scale data input with minimal errors.
- Market Research: Automates data collection from online sources for analysis.
- Invoice Processing: Extracts and inputs invoice data into accounting systems.
Transforming RPA
Traditional Robotic Process Automation (RPA) often struggles with dynamic interfaces. Copilot Studio’s computer use feature addresses this by:
- Real-Time Adaptation: Adjusts to UI changes without breaking workflows.
- Natural Language Commands: No coding required—describe tasks in plain language.
- Full Visibility: Makers can review activity logs, including screenshots and reasoning steps.
How to Join the Preview
Interested users can apply for the limited preview. Microsoft will also showcase the feature at Microsoft Build 2025—register here to attend.
This release follows recent Copilot Studio updates, including deep reasoning and .
Related News
AWS extends Bedrock AgentCore Gateway to unify MCP servers for AI agents
AWS announces expanded Amazon Bedrock AgentCore Gateway support for MCP servers, enabling centralized management of AI agent tools across organizations.
Jagged AI Already Disrupting Jobs Despite AGI Remaining Distant
Enterprise AI adoption focuses on real-world returns with 'jagged' systems, driving productivity gains but leading to white-collar job cuts across industries.
About the Author
Dr. Emily Wang
AI Product Strategy Expert
Former Google AI Product Manager with 10 years of experience in AI product development and strategy formulation. Led multiple successful AI products from 0 to 1 development process, now provides product strategy consulting for AI startups while writing AI product analysis articles for various tech media outlets.