Microsoft’s new ‘computer use’ feature gives Copilot Studio agents hands-on control of your computer

Copilot Studio just grew a pair of hands (and they're handy). A new wave is rolling into Copilot Studio with the early access research preview of ‘computer use’—a feature that lets your Copilot Studio agents do more than just sit pretty and offer suggestions. Now, they can interact with any system with a graphical user interface! With computer use, your agents get hands-on. They can click buttons, navigate menus, and type into fields just like any human user would. That means even if there’s no API in sight, the task still gets done.

Computer use isn’t fazed by changes in apps and websites —it rolls with it. Using built-in reasoning, it adapts in real time and fixes issues on the fly, so your workflows stay seamless and uninterrupted, as per Microsoft. And, behind the smarts is a solid foundation – Copilot Studio’s security and governance frameworks keeping it compliant with organisational and industry standards, right out of the box, Microsoft says.

With computer use baked into Copilot Studio, makers can now craft agents that handle UI tasks across both desktop apps and modern browsers—including Edge, Chrome, and Firefox. Be it clicking through menus or filling out forms, (looks like) the agent’s got it!

In Copilot Studio, users can automate tasks through natural language, with instant feedback and full visibility into the agent’s decisions. The agents navigate complex screens, adjust to changes on the fly, and offer a transparent activity history for clarity.

Notably, computer use runs on Microsoft-hosted infrastructure, so there’s also no need for organisations to manage their own servers. Enterprise data stays within Microsoft Cloud, and it’s not used to train the Frontier model—speeding up deployment, reducing maintenance, and cutting infrastructure costs, according to Microsoft. For example, it automates data entry, pulling info from multiple sources into a central system to cut down on manual work and errors. In market research, it helps teams gather and analyse online data for instant insights. And, for finance, it streamlines invoice processing, feeding data directly into accounting systems.

Microsoft says computer use agents are also said to revolutionise RPA by tackling dynamic interfaces and adapting in real-time, making automation more reliable and intuitive.