Artificial intelligence startup Anthropic is releasing a new tool that can understand what’s happening on a user’s computer screen and complete a range of online tasks for them — the latest example of tech companies expanding from chatbots that offer pithy responses to so-called AI agents that can act on a person’s behalf.
The new capability, called “computer use,” can interpret what a user is seeing on their computer and — with permission — take actions for them by browsing the web, clicking buttons and typing, Anthropic said Tuesday. The company is releasing a beta version to developers using its Claude technology, after testing the service with a limited set of enterprise customers in recent weeks. A growing number of AI companies are investing in building agents that field tasks for users with minimal human supervision, an attempt to fulfill the promise of artificial intelligence to radically increase productivity in our personal and professional lives.
On Monday, Microsoft Corp. launched a set of agent tools designed to send emails and manage records for workers. Salesforce Inc. touted its enterprise agent apps for customer service at its Dreamforce event last month. Anthropic is taking a different approach than many other companies have with agent tools. Rather than integrate with various applications on the backend, its technology can process what’s happening on a user’s computer screen in real time. The company said this method creates a more intuitive experience. “It’s going to be the first model ever to be able to use a computer the way that people do,” Jared Kaplan, co-founder and chief science officer at Anthropic, said in an interview with Bloomberg News.
In a pre-recorded demo, an Anthropic employee used the tool to figure out the logistics of taking a friend for a morning hike with views of the Golden Gate Bridge. Anthropic’s AI agent was able to search on Google to find hikes, map a route, check the sunrise time and send a calendar invite with details including what kind of clothing to wear — all with no human input beyond an initial prompt.
Anthropic has positioned itself as a safety-conscious AI company, but the new tool might invite added scrutiny. Technology that can access a user’s screen activity comes with heightened safety and security concerns. When Microsoft, for example, unveiled its AI-enabled “Recall” feature that created a record of everything users do on their computers, a backlash ensued over worries that the software could be vulnerable to hacking. It ended up relaunching the product with security upgrades.
Content Courtesy – Bloomberg
