--- title: "Anthropic adds computer use AI tool to Claude" description: "Anthropic has launched a new capability for its AI model Claude 3.5 Sonnet, allowing it to interact with computer interfaces like a human. This tool, now in public beta, enables developers to automate" type: "news" locale: "en" url: "https://longbridge.com/en/news/217554539.md" published_at: "2024-10-22T22:34:00.000Z" --- # Anthropic adds computer use AI tool to Claude > Anthropic has launched a new capability for its AI model Claude 3.5 Sonnet, allowing it to interact with computer interfaces like a human. This tool, now in public beta, enables developers to automate tasks and conduct research. Analysts note it reflects a shift towards AI agents, similar to existing robotic process automation tools. While it offers significant potential for enterprises, concerns about security and responsible usage remain. The tool is still imperfect, facing challenges with certain tasks, but Claude 3.5 Haiku, another model, excels in coding tasks and will be available soon. Anthropic on Tuesday introduced a new capability that uses computers the way people do, according to the AI startup. The function -- available now in public beta -- is part of the vendor’s large language model Claude 3.5 Sonnet, an updated version of which Anthropic also released on Tuesday along with another updated model, Claude 3.5 Haiku. Computer enables developers to direct Claude to look at a screen, move a cursor, click buttons and type text. Developers can use the new capability to automate repetitive tasks, build and test software and conduct open-ended functions like research, Anthropic said. To do this, developers will use an API built by Anthropic that can understand and interact with computer interfaces. ## AI agents The tool reflects the shift in the generative AI market to AI agents. The move to AI agents was marked by Salesforce introducing large action models and Agentforce, the CRM giant’s agentic AI platform. "Agent-based AI is the next big thing, and everyone is trying to figure out how to do it safely," said Futurum Group analyst Dion Hinchcliffe. Anthropic’s new capability can lead to many agent-based scenarios because it enables generative AI technology to use any application on a computer, Hinchcliffe said. The new capability presents new opportunities for enterprises, he added. "Most enterprise activities can potentially be automated using AI with direct computer use," Hinchcliffe continued. According to Anthropic, applications such as mobile work management platform Asana, graphic design platform Canva and food delivery service DoorDash used the computer use tool before it was launched in public beta. ## Similar to RPA, BPA While the new computer use format appears unique, it is similar to many robotic process automation (RPA) and business process automation (BPA) and other task automation systems that the business process management market is familiar with, said Forrester Research analyst Rowan Curran. "There are plenty of software companies that offer the exact type of capability that they're launching, the ability to basically have a machine interaction with a human interface, so controlling the pointer, taking on a keyboard, things of that nature," Curran said. "There are plenty of tools that already do this out there in the world." For example, IBM has BPA tools that can do the same tasks. Appian also helps vendors automate business tasks. "It's yet to be seen whether there is some specific advantage to how they are operating this capability, and how they might be specifically leveraging it with their family of language models," Curran said. AI computer use may be helpful and important in building larger-scale and complex AI agents across legacy systems where RPA has played a role over the past few decades, he added. ## Some risks While there is significant potential for enterprises looking to use this new tool, it also comes with risks. "I don't think it's smart to release yet,” Hinchcliffe said. "I don't think companies are ready to control all the issues ... around security, safety, responsible usage." The capability could make it easy for bad actors to hack systems easily because they direct an AI system to log into a computer system to try to find its vulnerabilities. While some enterprises might move quickly to try the new tool, others will take a careful approach. "Smart organizations are going to wait and see if the guardrails are in place," Hinchcliffe said. "There'll be a lot of people who will want to use it right now, and it's such a powerful tool that can cause a lot of problems inadvertently." The computer use function is still imperfect, Anthropic said. The tool currently finds it challenging to scroll, drag and zoom -- tasks that people can do effortlessly. Meanwhile, Claude 3.5 Haiku is strong on coding tasks and can follow instructions better than previous versions, Anthropic said. Claude 3.5 Haiku will be available later this month across Anthropic's first-party API, Amazon Bedrock and Google Cloud's Vertex AI. *Esther Ajao is a TechTarget Editorial news writer and podcast host covering artificial intelligence* *software and systems.* ### Related Stocks - [OpenAI.NA - OpenAI](https://longbridge.com/en/quote/OpenAI.NA.md) - [GOOG.US - Alphabet - C](https://longbridge.com/en/quote/GOOG.US.md) - [GOOGL.US - Alphabet](https://longbridge.com/en/quote/GOOGL.US.md) ## Related News & Research | Title | Description | URL | |-------|-------------|-----| | OpenAI 高管：工程师变成 “魔法师”，AI 将开启新一轮创业狂潮 | OpenAI 内部曝光：95% 工程师已用 AI 编程，代码审查全由 Codex 接管！负责人 Sherwin Wu 预言，未来两年模型将具备数小时长任务处理能力，工程师正变为指挥智能体的 “巫师”。随着模型吞噬中间层，为 “超级个体” 服 | [Link](https://longbridge.com/en/news/275998627.md) | | 为 AI 交易 “背书”！OpenAI 正敲定新一轮融资：以 8300 亿美元估值募资高达 1000 亿美元 | OpenAI 正以 8300 亿美元估值推进新一轮融资，目标筹集 1000 亿美元。软银拟领投 300 亿美元，亚马逊和英伟达可能各投 500 亿及 300 亿美元，微软拟投数十亿美元。本轮融资是 OpenAI 自去年秋季公司制改革以来的首 | [Link](https://longbridge.com/en/news/276298180.md) | | 高院否决，特朗普将被迫退税！华尔街 “早就下注”，商务部长儿子甚至一度参与 | 去年 10 月投资机构以每美元 20-40 美分的折扣价从进口商手中购入关税退款索赔权，单笔交易规模多在 200 万至 2000 万美元。投资者有望获得超 8 倍回报。但退款前景仍存不确定性，涉及金额达数十亿美元，各方仍在观望。 | [Link](https://longbridge.com/en/news/276502404.md) | | 每千次展示 60 美元！OpenAI 用高价拉开 “AI 广告” 大幕 | 为应对 AI 巨额开支，OpenAI 正式测试广告，CPM60 美元起步、最低投入 20 万美元，定位高端渠道，直接挑战谷歌万亿美元市场，WPP 等顶级代理已率先合作。但转型风险并存：需平衡用户信任，承诺不用私聊数据；对手 Anthropi | [Link](https://longbridge.com/en/news/275993077.md) | | OpenClaw 之父爆猛料：Meta 和 OpenAI 跪着抢人，小扎亲自求收购 | 在一场重磅播客访谈中，OpenClaw 之父 Peter Steinberger 透露，Meta 的扎克伯格和 OpenAI 的 Sam Altman 都在积极拉拢他，甚至扎克伯格亲自表示对 OpenClaw 的赞赏。两大科技巨头同时争抢人 | [Link](https://longbridge.com/en/news/275962731.md) | --- > **Disclaimer**: This article is for reference only and does not constitute any investment advice.