GitHub Copilot Gains Desktop Application Interaction Capabilities

01 What happened

GitHub Copilot now supports computer use, a feature allowing the assistant to read screen content and operate desktop applications directly via the Copilot CLI and desktop app.

02 Key details

• Copilot can perform tasks such as clicking controls, typing text, scrolling, and navigating workflows across various desktop applications.
• Copilot asks for approval before controlling an application; users can review or reset apps they previously allowed.
• Organizations can choose to disable the computer use functionality through managed settings.

03 Why it matters

Beyond coding, Copilot can automate workflows in desktop applications that lack an API, command-line interface or MCP integration.

04 Who it matters to

Software developers, IT specialists and business process automation experts.