The company Anthropic, responsible for artificial intelligence (AI) Claude, announced a version of the service that allows him to use the computer in his place. The novelty is present in the Claude 3.5 Sonnetlatest update to the free-to-use variant of the platform.
According to the company, the new AI is able to interact directly with your computer — something beyond other PC services, which currently only perform actions within the browser or in specific applications.
The function for now is in public beta phase and is not expected to be released in stable AI. Developers interested in participating can start testing the new version from this link, which includes a form for sending criticism, suggestions and bug reports.
What can AI do on your PC?
Among the tasks already confirmed, Anthropic’s AI is capable of moving the mouse cursor across the screen, clicking on “relevant locations” and even filling in text fields from a virtual keyboard. It even interacts with programs such as text editors and even the browser.
How the feature works involves taking multiple screenshots of your computer and “put the pieces together” of what is in the foreground when you request an action. The operation is similar to the controversial Recall, a tool that was significantly modified in Windows 11 after criticism.
Anthropic warns that Claude currently does it all”slowly and subject to frequent errors“, in addition to being limited to a few actions at the current stage.
The AI, for example, cannot drag files, zoom or interact with notifications that disappear from the screen after some time. Furthermore, for ethical and security reasons, it is not able to access social networking or government sites, nor register domains on its own.
Source: https://www.tecmundo.com.br/software/294180-ia-claude-anthropic-controlar-computador.htm
