Google has introduced a new feature for its Gemini assistant that allows the artificial intelligence to take direct control of Mac computers. According to The Hindu BusinessLine, the capability, described as “computer use,” enables the assistant to interact with various applications and complete tasks on behalf of the user. This includes actions such as clicking, typing, navigating menus, and filling out forms. The move marks a significant shift in the industry toward AI agents that perform concrete actions rather than merely answering questions.

The feature is currently available to users in the United States who have subscribed to Google AI Plus, Pro, or Ultra plans and are using the Mac Gemini app. Google stated that the assistant can help with specific workflows, such as color-grading batches of photos using preferred design software or analyzing clothing images in a folder to prepare them for resale websites. When the tool is active, it operates in an isolated background window, allowing consumers to continue using their main screen and cursor. Users retain control by choosing which apps Gemini can access, watching the process live, pausing at any time, and approving key actions before they occur.

This launch places additional pressure on Apple to enhance the capabilities of its Siri assistant. The Hindu BusinessLine notes that the latest development is a step in the AI industry’s shift toward assistants that can perform tasks. While the current version of Siri can handle tasks within Apple’s own applications, such as sending iMessages or adding calendar appointments, its powers do not extend to most third-party software. The report highlights that Apple has released frameworks allowing outside developers to enable these abilities in their apps, suggesting that Siri’s functionality could expand in the near future.

Apple’s relationship with third-party AI tools may face increased tension as more agents introduce computer-use features. The company has previously warned of rising risks associated with granting broad data access to AI software and has pledged to introduce new privacy controls on Macs. Meanwhile, competitors like OpenAI with ChatGPT and Meta Platforms with Muse have already offered similar computer-use features for their Mac software, allowing their chatbots to interact with local computer files and other applications. The Hindu BusinessLine reports that these developments are part of an intense race among tech and AI companies to develop agents that can act on behalf of the user.